{"schemaVersion":"jobsearcher.job.v1","id":"6f6e11490c5f83a0b9e528ec","url":"https://jobsearcher.com/jobs/6f6e11490c5f83a0b9e528ec","canonicalUrl":"https://jobsearcher.com/jobs/6f6e11490c5f83a0b9e528ec","title":"Principal Data Engineer - AWS","description":"POSITION SUMMARY:\n\nMetis Technology Solutions is seeking an experienced Principal Data Engineer – AWS to join our Software Operations team. This engineer will work closely with software developers, researchers, analysts, database engineers, and system administrators to design, develop, deploy, and operate the data infrastructure and pipelines connecting research platforms, external data sources, cloud-based services, and the project's Sherlock data warehouse.\n\nThis position:\n\nArchitects, designs, develops, deploys, and maintains scalable and reliable ETL/ELT data pipelines in Amazon Web Services (AWS).\nDesigns automated ingestion and processing solutions for structured, semi-structured, unstructured, batch, and streaming data.\nDevelops production-quality data-processing and pipeline software using Python, SQL, and shell scripting.\nDesigns and maintain workflow orchestration solutions using technologies such as Apache Airflow, Dagster, AWS Step Functions, or equivalent platforms.\nDesigns and implements real-time and near-real-time streaming and event-driven data pipelines using technologies such as AWS Kinesis, Amazon Data Firehose, Kafka, RabbitMQ, SQS/SNS, or equivalent technologies.\nDevelops and maintains cloud data solutions using AWS services such as Amazon S3, AWS Lambda, Amazon Redshift, Amazon RDS, Amazon DynamoDB, Amazon EC2, API Gateway, IAM, and CloudWatch, as appropriate to project requirements.\nAdministers and optimizes relational databases and cloud data warehouses, including PostgreSQL/PostGIS and Amazon Redshift or comparable technologies.\nDevelops and maintains infrastructure as code (IaC) using Terraform or equivalent technologies.\nDevelops and maintains automated deployment and CI/CD processes for data applications and supporting infrastructure.\nDesigns pipelines and supporting infrastructure for reliability, scalability, maintainability, observability, security, and efficient use of AWS resources.\nImplements appropriate AWS security practices, including IAM roles and policies, encryption, secrets management, network controls, logging, and least-privilege access.\nDevelops monitoring, logging, metrics, and alerting that provide operational visibility into data-pipeline health and performance.\nDocuments data architectures, data flows, interfaces, infrastructure, deployment processes, operational procedures, and troubleshooting practices.\nCollaborates with researchers, analysts, and application developers to translate research and application requirements into reliable and maintainable data-processing solutions.\n\nMINIMUM QUALIFICATIONS:\n\nEducation:\n\nBachelor’s degree or higher in computer science, computer engineering, information systems, or a related technical discipline.\n\nRequired Skills and knowledge:\n\nMinimum 10 years of progressively responsible software engineering, data engineering, database engineering, or closely related technical experience.\nMinimum 5 years of substantial hands-on AWS experience, including the design, implementation, deployment, and operation of production data-processing or data-pipeline solutions.\nDemonstrated experience architecting and developing ETL/ELT pipelines involving large, heterogeneous, or rapidly changing datasets.\nStrong hands-on experience with AWS data and compute services. Relevant technologies may include S3, Lambda, Redshift, RDS, DynamoDB, Kinesis, Data Firehose, EC2, API Gateway, IAM, and CloudWatch.\nAdvanced SQL skills and substantial experience working with relational database systems, preferably PostgreSQL/PostGIS.\nDemonstrated experience with cloud data warehouses such as Amazon Redshift or comparable technologies.\nExperience with NoSQL databases or document/key-value data stores such as DynamoDB, MongoDB, or comparable technologies.\nDemonstrated experience with data-pipeline and workflow orchestration using Apache Airflow, Dagster, AWS Step Functions, or comparable technologies.\nExperience designing or implementing streaming, message-oriented, or event-driven data-processing systems using technologies such as Kinesis, Data Firehose, Kafka, RabbitMQ, SQS/SNS, or comparable technologies.\nDemonstrated experience diagnosing and correcting database and data-pipeline performance problems.\nHands-on experience with infrastructure as code, preferably Terraform or an equivalent technology.\nWorking knowledge of AWS security concepts including IAM, encryption, secrets management, network security, logging, and least-privilege access.\nStrong understanding of modern software-engineering practices, including modular design, automated testing, version control, documentation, security, and maintainable code.\nStrong analytical and troubleshooting skills and demonstrated ability to diagnose complex problems spanning applications, databases, data pipelines, and cloud infrastructure.\nProven ability to evaluate technical alternatives, make sound architectural decisions, and communicate the rationale and tradeoffs associated with those decisions.\nExcellent written and verbal communication skills and demonstrated ability to collaborate effectively with software engineers, researchers, analysts, system administrators, and other technical stakeholders.\n\nLOCATION SPECIFIC REQUIRMENTS: NASA Ames Research Center, Moffett Field CA\n\nSECURITY CLEARANCE: Applicant must be eligible to obtain a U.S. Government Public Trust Clearance. Must be a U.S. Citizen or Permanent Resident.\n\nEEOE Including Vets and Disability","company":"Metis Technology Solutions","rawCompany":"metis technology solutions","city":"Mountain View","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-09-06T13:29:11.656Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Principal Data Engineer - AWS","description":"POSITION SUMMARY:\n\nMetis Technology Solutions is seeking an experienced Principal Data Engineer – AWS to join our Software Operations team. This engineer will work closely with software developers, researchers, analysts, database engineers, and system administrators to design, develop, deploy, and operate the data infrastructure and pipelines connecting research platforms, external data sources, cloud-based services, and the project's Sherlock data warehouse.\n\nThis position:\n\nArchitects, designs, develops, deploys, and maintains scalable and reliable ETL/ELT data pipelines in Amazon Web Services (AWS).\nDesigns automated ingestion and processing solutions for structured, semi-structured, unstructured, batch, and streaming data.\nDevelops production-quality data-processing and pipeline software using Python, SQL, and shell scripting.\nDesigns and maintain workflow orchestration solutions using technologies such as Apache Airflow, Dagster, AWS Step Functions, or equivalent platforms.\nDesigns and implements real-time and near-real-time streaming and event-driven data pipelines using technologies such as AWS Kinesis, Amazon Data Firehose, Kafka, RabbitMQ, SQS/SNS, or equivalent technologies.\nDevelops and maintains cloud data solutions using AWS services such as Amazon S3, AWS Lambda, Amazon Redshift, Amazon RDS, Amazon DynamoDB, Amazon EC2, API Gateway, IAM, and CloudWatch, as appropriate to project requirements.\nAdministers and optimizes relational databases and cloud data warehouses, including PostgreSQL/PostGIS and Amazon Redshift or comparable technologies.\nDevelops and maintains infrastructure as code (IaC) using Terraform or equivalent technologies.\nDevelops and maintains automated deployment and CI/CD processes for data applications and supporting infrastructure.\nDesigns pipelines and supporting infrastructure for reliability, scalability, maintainability, observability, security, and efficient use of AWS resources.\nImplements appropriate AWS security practices, including IAM roles and policies, encryption, secrets management, network controls, logging, and least-privilege access.\nDevelops monitoring, logging, metrics, and alerting that provide operational visibility into data-pipeline health and performance.\nDocuments data architectures, data flows, interfaces, infrastructure, deployment processes, operational procedures, and troubleshooting practices.\nCollaborates with researchers, analysts, and application developers to translate research and application requirements into reliable and maintainable data-processing solutions.\n\nMINIMUM QUALIFICATIONS:\n\nEducation:\n\nBachelor’s degree or higher in computer science, computer engineering, information systems, or a related technical discipline.\n\nRequired Skills and knowledge:\n\nMinimum 10 years of progressively responsible software engineering, data engineering, database engineering, or closely related technical experience.\nMinimum 5 years of substantial hands-on AWS experience, including the design, implementation, deployment, and operation of production data-processing or data-pipeline solutions.\nDemonstrated experience architecting and developing ETL/ELT pipelines involving large, heterogeneous, or rapidly changing datasets.\nStrong hands-on experience with AWS data and compute services. Relevant technologies may include S3, Lambda, Redshift, RDS, DynamoDB, Kinesis, Data Firehose, EC2, API Gateway, IAM, and CloudWatch.\nAdvanced SQL skills and substantial experience working with relational database systems, preferably PostgreSQL/PostGIS.\nDemonstrated experience with cloud data warehouses such as Amazon Redshift or comparable technologies.\nExperience with NoSQL databases or document/key-value data stores such as DynamoDB, MongoDB, or comparable technologies.\nDemonstrated experience with data-pipeline and workflow orchestration using Apache Airflow, Dagster, AWS Step Functions, or comparable technologies.\nExperience designing or implementing streaming, message-oriented, or event-driven data-processing systems using technologies such as Kinesis, Data Firehose, Kafka, RabbitMQ, SQS/SNS, or comparable technologies.\nDemonstrated experience diagnosing and correcting database and data-pipeline performance problems.\nHands-on experience with infrastructure as code, preferably Terraform or an equivalent technology.\nWorking knowledge of AWS security concepts including IAM, encryption, secrets management, network security, logging, and least-privilege access.\nStrong understanding of modern software-engineering practices, including modular design, automated testing, version control, documentation, security, and maintainable code.\nStrong analytical and troubleshooting skills and demonstrated ability to diagnose complex problems spanning applications, databases, data pipelines, and cloud infrastructure.\nProven ability to evaluate technical alternatives, make sound architectural decisions, and communicate the rationale and tradeoffs associated with those decisions.\nExcellent written and verbal communication skills and demonstrated ability to collaborate effectively with software engineers, researchers, analysts, system administrators, and other technical stakeholders.\n\nLOCATION SPECIFIC REQUIRMENTS: NASA Ames Research Center, Moffett Field CA\n\nSECURITY CLEARANCE: Applicant must be eligible to obtain a U.S. Government Public Trust Clearance. Must be a U.S. Citizen or Permanent Resident.\n\nEEOE Including Vets and Disability","datePosted":"2026-09-06T13:29:11.656Z","dateModified":"2026-09-06T13:29:11.656Z","hiringOrganization":{"@type":"Organization","name":"Metis Technology Solutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Mountain View","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"6f6e11490c5f83a0b9e528ec"},"url":"https://jobsearcher.com/jobs/6f6e11490c5f83a0b9e528ec"}}