Sr Data Quality Engineer Azure Focus

Sr Data Quality Engineer – Azure Focus Chicago, IL (loop/downtown) – 2 days work from home (WFH), 3 days onsite Summary: This position focuses on building automated tesing frameworks to ensure data quality and reliability across data pipelines in our Azure, Databricks, SQL Server/Azure SQL and Medallion Architecture (Bronze, Silver, Gold layers) environment. We use Python and SQL extensively on our data engineering team, and are looking for candidates who can come to the table with these skills, and a candidate coming from an Azure/Databricks environment. We are also looking for candidates that have strong experience building automated validation frameworks using tools – if you have experience with DQX (Databricks Data Quality Framework), that would be awesome, but anything similar works. Last, we are leaning into AI on our engineering teams, and you'll have the opportunity to leverage tools like Claude Code, so any experience in this area is also a nice to have. What you'll be doingDesign and implement scalable end-to-end testing frameworks for data pipelinesValidate ingestion from APIs, SQL Server, and flat filesEnsure data quality across Medallion architecture layers (Bronze, Silver, Gold)Build automated checks for schema validation, data integrity, and transformationsDevelop reusable validation patterns using Great Expectations or similar frameworksLeverage Claude Code and prompt engineering to accelerate test generation and standardizationCreate reusable AI-driven testing assets (.md skills, templates) and workflows for AI-assisted coding and testingIntegrate testing into CI/CD pipelines (Azure DevOps, GitHub Actions)Collaborate with data engineers, Product, and DevOps to define data quality standards and acceptance criteriaMonitor and improve data reliability, observability, and test coverageInvestigate data quality issues and drive root-cause resolutionSkills we're seeking5+ years of experience with Data Engineering and/or Data Quality EngineeringMust have strong experience with Data Quality EngineeringMust have experience with data validation tools such as DQX, Great Expectations, etc.Must have strong experience with Data (Quality) Engineering in Azure environmentsMust have experience with Medallion ArchitectureMust have strong experience with SQL ServerPython experienceNice to havesBachelor's or Master's Degree in an IT related fieldSpark and/or PySpark experienceExperience with Claud CodeExperience with Azure DevOps, CI/CD pipeliens, etc.Bicep experience would be awesome, or any IaC for that matter