Senior Data Quality Engineer – Data Pipelines (AWS)
Dice is the leading career destination for tech experts at every stage of their careers. Our client, EVEREST CONSULTING GROUP, INC, is seeking the following. Apply via Dice today!Senior Data Quality Engineer – Data Pipelines (AWS)Introduction:We are seeking a Senior Quality Engineer to own test planning and validation of data pipelines within an AWS-based data lakehouse environment. This role will work closely with developers, DevOps, and data teams to ensure data integrity and reliability across CI/CD pipelines and cloud workflows.Responsibilities:Own end-to-end test planning and execution for AWS-based data lakehouse pipelines and integrationsDesign, develop, and maintain automated test scripts to validate data pipelines and support CI/CD workflowsValidate data workflows using AWS services including S3, Glue, and AthenaIndependently support and troubleshoot CI/CD pipelines using CodeCommit, CodeBuild, and CodePipelineReview build and deployment logs to identify failures and perform root cause analysisWork with Terraform/Terrahub components within build pipelines (CodeBuild)Perform functional, regression, and data validation testing across releasesTrack, document, and drive defects through resolution in collaboration with development teamsDefine test strategies, scope, and estimates for releases and test cyclesCollaborate with cross-functional teams to support UAT and production readinessCommunicate testing progress, risks, and results to stakeholdersRequirements:Required Skills:14+ years overall experience in software quality, testing, and data pipeline validation5+ years in testing AWS-based data pipelines and cloud workflowsExperience working in Agile environments (Scrum or Kanban)Familiarity with cloud-based and DevOps-driven development environmentsWorking knowledge of SQL and relational databasesExperience with software testing tools (e.g., Jira, qTest, ALM, Selenium)Basic proficiency with Git version control (clone, commit, push, pull, branching)Basic command-line proficiency (Linux, PowerShell, CMD)Hands-on experience with AWS services: S3, Glue, Athena, CodeCommit, CodeBuild, CodePipelineExperience with Terraform/Terrahub in CI/CD pipelinesLog analysis and troubleshooting in build/deployment pipelinesPreferred Skills:Educational background in Computer Science, Engineering, Information Systems, or equivalent