{"schemaVersion":"jobsearcher.job.v1","id":"46f78f2d6ee317f3c6233302","url":"https://jobsearcher.com/jobs/46f78f2d6ee317f3c6233302","canonicalUrl":"https://jobsearcher.com/jobs/46f78f2d6ee317f3c6233302","title":"DATA QUALITY ENGINEER","description":"Job Title: Senior Data QA / Test EngineerLocation: Plano, TX 75024Visa :- Independent Visa OnlyDuration: Contractual / Fulltime Role (W2)Note:We are looking for a Senior Data QA / Test Engineer with strong experience in data/ETL testing, SQL Server, Databricks, Azure Data Factory, PySpark, and data migration testing. The ideal candidate will own the testing strategy for migrating a SQL Server data platform to Databricks on Azure, validate data parity between legacy and modern platforms, establish quality gates, and ensure end-to-end validation of ADF pipelines and Delta Lake workloads.Key Skills (50%)Strong experience with Data QA / ETL Testing / Data ValidationStrong SQL experience including T-SQL, Spark SQL, joins, window functions, aggregates, and data reconciliationHands-on experience with Databricks, Delta Lake, notebooks, Jobs/Workflows, and Unity CatalogHands-on experience with Azure Data Factory (ADF) including pipelines, triggers, datasets, monitoring, and debuggingStrong experience with PySpark for test automation and reconciliation frameworksExperience with source-to-target reconciliation, row counts, checksums/hashes, aggregates, and row-level data comparisonsExperience testing data transformations, migrations, schema changes, incremental loads, and business logicExperience integrating automated tests into CI/CD using Azure DevOps or GitHub ActionsExperience (30%)5+ years of experience in Data / ETL TestingExperience testing at least one data platform migrationStrong experience validating SQL Server data platforms and modern cloud data platformsExperience converting SQL business logic, stored procedures, and views into test casesExperience validating PySpark / Spark SQL outputs against legacy SQL resultsExperience defining quality gates, entry/exit criteria, test metrics, and release readinessExperience testing ADF pipelines, dependencies, parameters, triggers, retries, and incremental/watermark logicExperience with Delta Lake MERGE/upsert, SCD Type 1/2, schema evolution, deduplication, and late-arriving dataExperience with UAT, regression testing, defect management, and production validationOther Skills (20%)Strong analytical, troubleshooting, and problem-solving skillsExperience reporting defects, reconciliation results, test metrics, and go/no-go readinessStrong communication and collaboration with Data Engineers, Data Quality Engineers, Developers, and Project LeadershipExperience working in Agile/Scrum environmentsStrong documentation and test strategy development skillsExperience with pytest or similar test automation frameworksKnowledge of Terraform, Databricks Asset Bundles, and Azure DevOpsKnowledge of Databricks Labs DQX, Great Expectations, Soda, or Lakeflow/DLT expectations is an assetExperience with Spark performance testing including partitioning, file sizing, and cluster sizing is an assetKnowledge of SSIS, SSRS, or Power BI report validation is an assetMust HaveData / ETL TestingSQL / T-SQL / Spark SQLDatabricks / Delta LakeAzure Data FactoryPySparkData Migration TestingSource-to-Target ReconciliationData Validation / Quality TestingTest Automation / pytestCI/CD / Azure DevOps or GitHub ActionsQuality Gates / Test StrategyResponsibilitiesDefine and execute the migration test strategy and test plan covering schema, data, transformation logic, performance, and regression testingBuild automated source-to-target reconciliation for migrated tablesValidate row counts, column-level checksums/hashes, aggregates, and row-level differencesConvert legacy SQL business logic, stored procedures, and views into test casesValidate equivalent PySpark/Spark SQL outputs against legacy SQL resultsDefine and enforce quality gates across code merge, Bronze/Silver/Gold promotion, UAT sign-off, and production cutoverValidate Azure Data Factory pipelines including parameters, triggers, dependencies, mappings, failure/retry paths, incremental loads, and watermark logicTest Delta Lake behavior including MERGE/upsert, SCD Type 1/2, schema evolution, deduplication, and late-arriving dataIntegrate automated tests into CI/CD pipelines using Azure DevOps, GitHub Actions, or equivalentPartner with the Data Quality Engineer to embed DQX/data-quality checks into pipelinesReport defects, reconciliation results, test metrics, and go/no-go readiness to project leadershipSupport UAT, regression testing, production validation, defect resolution, and migration cutover activitiesEnsure zero critical data defects are introduced into production following each migration waveIf interested, please share your resume at:📧 Afzal.Khan@buzzclan.com","company":"Buzzclan","rawCompany":"buzzclan","city":"Plano","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-10-08T07:52:39.633Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"11-3051.01","title":"Quality Control Systems Managers","slug":"quality-control-systems-managers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"DATA QUALITY ENGINEER","description":"Job Title: Senior Data QA / Test EngineerLocation: Plano, TX 75024Visa :- Independent Visa OnlyDuration: Contractual / Fulltime Role (W2)Note:We are looking for a Senior Data QA / Test Engineer with strong experience in data/ETL testing, SQL Server, Databricks, Azure Data Factory, PySpark, and data migration testing. The ideal candidate will own the testing strategy for migrating a SQL Server data platform to Databricks on Azure, validate data parity between legacy and modern platforms, establish quality gates, and ensure end-to-end validation of ADF pipelines and Delta Lake workloads.Key Skills (50%)Strong experience with Data QA / ETL Testing / Data ValidationStrong SQL experience including T-SQL, Spark SQL, joins, window functions, aggregates, and data reconciliationHands-on experience with Databricks, Delta Lake, notebooks, Jobs/Workflows, and Unity CatalogHands-on experience with Azure Data Factory (ADF) including pipelines, triggers, datasets, monitoring, and debuggingStrong experience with PySpark for test automation and reconciliation frameworksExperience with source-to-target reconciliation, row counts, checksums/hashes, aggregates, and row-level data comparisonsExperience testing data transformations, migrations, schema changes, incremental loads, and business logicExperience integrating automated tests into CI/CD using Azure DevOps or GitHub ActionsExperience (30%)5+ years of experience in Data / ETL TestingExperience testing at least one data platform migrationStrong experience validating SQL Server data platforms and modern cloud data platformsExperience converting SQL business logic, stored procedures, and views into test casesExperience validating PySpark / Spark SQL outputs against legacy SQL resultsExperience defining quality gates, entry/exit criteria, test metrics, and release readinessExperience testing ADF pipelines, dependencies, parameters, triggers, retries, and incremental/watermark logicExperience with Delta Lake MERGE/upsert, SCD Type 1/2, schema evolution, deduplication, and late-arriving dataExperience with UAT, regression testing, defect management, and production validationOther Skills (20%)Strong analytical, troubleshooting, and problem-solving skillsExperience reporting defects, reconciliation results, test metrics, and go/no-go readinessStrong communication and collaboration with Data Engineers, Data Quality Engineers, Developers, and Project LeadershipExperience working in Agile/Scrum environmentsStrong documentation and test strategy development skillsExperience with pytest or similar test automation frameworksKnowledge of Terraform, Databricks Asset Bundles, and Azure DevOpsKnowledge of Databricks Labs DQX, Great Expectations, Soda, or Lakeflow/DLT expectations is an assetExperience with Spark performance testing including partitioning, file sizing, and cluster sizing is an assetKnowledge of SSIS, SSRS, or Power BI report validation is an assetMust HaveData / ETL TestingSQL / T-SQL / Spark SQLDatabricks / Delta LakeAzure Data FactoryPySparkData Migration TestingSource-to-Target ReconciliationData Validation / Quality TestingTest Automation / pytestCI/CD / Azure DevOps or GitHub ActionsQuality Gates / Test StrategyResponsibilitiesDefine and execute the migration test strategy and test plan covering schema, data, transformation logic, performance, and regression testingBuild automated source-to-target reconciliation for migrated tablesValidate row counts, column-level checksums/hashes, aggregates, and row-level differencesConvert legacy SQL business logic, stored procedures, and views into test casesValidate equivalent PySpark/Spark SQL outputs against legacy SQL resultsDefine and enforce quality gates across code merge, Bronze/Silver/Gold promotion, UAT sign-off, and production cutoverValidate Azure Data Factory pipelines including parameters, triggers, dependencies, mappings, failure/retry paths, incremental loads, and watermark logicTest Delta Lake behavior including MERGE/upsert, SCD Type 1/2, schema evolution, deduplication, and late-arriving dataIntegrate automated tests into CI/CD pipelines using Azure DevOps, GitHub Actions, or equivalentPartner with the Data Quality Engineer to embed DQX/data-quality checks into pipelinesReport defects, reconciliation results, test metrics, and go/no-go readiness to project leadershipSupport UAT, regression testing, production validation, defect resolution, and migration cutover activitiesEnsure zero critical data defects are introduced into production following each migration waveIf interested, please share your resume at:📧 Afzal.Khan@buzzclan.com","datePosted":"2026-10-08T07:52:39.633Z","dateModified":"2026-10-08T07:52:39.633Z","hiringOrganization":{"@type":"Organization","name":"Buzzclan","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Plano","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"46f78f2d6ee317f3c6233302"},"url":"https://jobsearcher.com/jobs/46f78f2d6ee317f3c6233302"}}