{"schemaVersion":"jobsearcher.job.v1","id":"ce32d690a24053828914e34d","url":"https://jobsearcher.com/jobs/ce32d690a24053828914e34d","canonicalUrl":"https://jobsearcher.com/jobs/ce32d690a24053828914e34d","title":"Data Engineer","description":"About Infinitive:Infinitive is a data and AI consultancy that helps clients modernize, monetize, and operationalize their data to generate lasting value. They pride themselves on their deep industry and technology expertise, ensuring that they drive and sustain the adoption of new capabilities. Infinitive is committed to aligning their team with their clients' culture, ensuring a successful partnership by bringing the right mix of talent and skills for high return on investment.Infinitive has earned recognition as one of the \"Best Small Firms to Work For\" by Consulting Magazine, receiving this accolade 8 times, most recently in 2025. They have also been honored as a “Top Workplace” by the Washington Post, “Best Places to Work” by the Washington Business Journal, and “Best Places to Work” by Virginia Business.Job Summary:We are seeking a skilled Data Engineer to join our team and play a key role in designing, building, and maintaining robust data pipelines and platforms. The ideal candidate will have strong experience with Python, AWS (Glue, S3, Lambda, CloudWatch), Databricks, Apache Spark, SQL, Snowflake, and DynamoDB. This role involves working with large-scale data processing systems, optimizing ETL/ELT workflows, and ensuring the reliability, scalability, and security of data solutions.Key Responsibilities:Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue, Databricks, and Apache SparkWork with structured and semi-structured data in Snowflake, DynamoDB, and S3Optimize and troubleshoot Spark jobs for performance and cost efficiencyDevelop and maintain Lambda functions to support real-time and batch data processingImplement data quality, validation, and monitoring using CloudWatch and other observability toolsDesign and optimize complex SQL queries for data transformation, aggregation, and reportingCollaborate with cross-functional teams, including Data Scientists, Analysts, and DevOps teams, to support data-driven decision-makingImplement best practices for data security, governance, and compliance in the cloud environmentAutomate data workflows and CI/CD pipelines using infrastructure-as-code and Git-based version controlRequired Qualifications:3+ years of experience in Data Engineering or a similar roleStrong proficiency in Python for data processing and automationHands-on experience with AWS services including Glue, S3, Lambda, CloudWatch, DynamoDBExpertise in Databricks and Apache Spark for large-scale data processingProficient in SQL for querying and manipulating structured dataExperience working with Snowflake, including schema design and performance tuningKnowledge of data lake and data warehouse architecturesFamiliarity with data security, IAM roles, and cloud-based authentication mechanismsStrong problem-solving and debugging skills in a cloud-based data environmentPreferred Qualifications:Experience with streaming data architectures using Kafka, Kinesis, or Pub/SubKnowledge of orchestration tools such as Airflow, Step Functions, or MWAAExperience with Terraform or CloudFormation for infrastructure automationUnderstanding of data governance frameworks (e.g., Dataplex, Alation, or Unity Catalog)Experience in CI/CD and DevOps practices for data engineering pipelinesHands-on experience with monitoring and logging tools, including Splunk and NewRelic","company":"Infinitive","rawCompany":"infinitive","city":"McLean","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-04-12T17:46:29.426Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"About Infinitive:Infinitive is a data and AI consultancy that helps clients modernize, monetize, and operationalize their data to generate lasting value. They pride themselves on their deep industry and technology expertise, ensuring that they drive and sustain the adoption of new capabilities. Infinitive is committed to aligning their team with their clients' culture, ensuring a successful partnership by bringing the right mix of talent and skills for high return on investment.Infinitive has earned recognition as one of the \"Best Small Firms to Work For\" by Consulting Magazine, receiving this accolade 8 times, most recently in 2025. They have also been honored as a “Top Workplace” by the Washington Post, “Best Places to Work” by the Washington Business Journal, and “Best Places to Work” by Virginia Business.Job Summary:We are seeking a skilled Data Engineer to join our team and play a key role in designing, building, and maintaining robust data pipelines and platforms. The ideal candidate will have strong experience with Python, AWS (Glue, S3, Lambda, CloudWatch), Databricks, Apache Spark, SQL, Snowflake, and DynamoDB. This role involves working with large-scale data processing systems, optimizing ETL/ELT workflows, and ensuring the reliability, scalability, and security of data solutions.Key Responsibilities:Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue, Databricks, and Apache SparkWork with structured and semi-structured data in Snowflake, DynamoDB, and S3Optimize and troubleshoot Spark jobs for performance and cost efficiencyDevelop and maintain Lambda functions to support real-time and batch data processingImplement data quality, validation, and monitoring using CloudWatch and other observability toolsDesign and optimize complex SQL queries for data transformation, aggregation, and reportingCollaborate with cross-functional teams, including Data Scientists, Analysts, and DevOps teams, to support data-driven decision-makingImplement best practices for data security, governance, and compliance in the cloud environmentAutomate data workflows and CI/CD pipelines using infrastructure-as-code and Git-based version controlRequired Qualifications:3+ years of experience in Data Engineering or a similar roleStrong proficiency in Python for data processing and automationHands-on experience with AWS services including Glue, S3, Lambda, CloudWatch, DynamoDBExpertise in Databricks and Apache Spark for large-scale data processingProficient in SQL for querying and manipulating structured dataExperience working with Snowflake, including schema design and performance tuningKnowledge of data lake and data warehouse architecturesFamiliarity with data security, IAM roles, and cloud-based authentication mechanismsStrong problem-solving and debugging skills in a cloud-based data environmentPreferred Qualifications:Experience with streaming data architectures using Kafka, Kinesis, or Pub/SubKnowledge of orchestration tools such as Airflow, Step Functions, or MWAAExperience with Terraform or CloudFormation for infrastructure automationUnderstanding of data governance frameworks (e.g., Dataplex, Alation, or Unity Catalog)Experience in CI/CD and DevOps practices for data engineering pipelinesHands-on experience with monitoring and logging tools, including Splunk and NewRelic","datePosted":"2026-04-12T17:46:29.426Z","dateModified":"2026-04-12T17:46:29.426Z","hiringOrganization":{"@type":"Organization","name":"Infinitive","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"McLean","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"ce32d690a24053828914e34d"},"url":"https://jobsearcher.com/jobs/ce32d690a24053828914e34d"}}