Data Quality Engineer (Databricks)
One of our clients is looking for an experienced Data Quality Engineer – USA (Remote) for a Contract opportunity. Must-Have Keywords: Open Data Contract Standard (ODCS), Data Quality Engineering, Python, SQL, Databricks, Data Contract Validation, Automated Testing Frameworks, Data Profiling, Schema Validation, Data Validation, ETL/ELT Testing, Source-to-Target Validation, Data Reconciliation, Regression Testing, Root Cause Analysis, Data Harmonization, YAML, JSON, Test Automation, Data Quality Rules
Required Skills:
7+ years of overall experience in Data Quality Engineering, Data QA, ETL testing, or data validation.
Hands-on experience with Open Data Contract Standard (ODCS) and contract-driven data validation.
Strong Python programming skills for developing reusable testing frameworks, validation engines, and automation utilities.
Advanced SQL skills for data profiling, reconciliation, and complex data-quality validation.
Hands-on experience with Databricks notebooks and automated data validation workflows.
Experience building automated, declarative testing frameworks based on data contract definitions and field-level validation rules.
Strong expertise in schema validation, data types, null checks, uniqueness, record counts, and cell-level data comparisons.
Experience developing centralized test-result collection, severity-based reporting, and reusable test components.
Strong understanding of ETL/ELT processes, source-to-target validation, data harmonization, and data pipeline testing.
Experience investigating data-quality defects, performing root-cause analysis, and developing regression tests.
Experience scaling automated validation frameworks across multiple data contracts and source systems.
Familiarity with YAML/JSON, Git, code reviews, debugging, and maintaining shared testing infrastructure.
Excellent analytical, problem-solving, communication, and collaboration skills.
Interested candidates: Please send your updated resume to puja@phtstaffing.com