{"schemaVersion":"jobsearcher.job.v1","id":"a52129433df5c401f5d4d571","url":"https://jobsearcher.com/jobs/a52129433df5c401f5d4d571","canonicalUrl":"https://jobsearcher.com/jobs/a52129433df5c401f5d4d571","title":"Senior Data Engineer","description":"About the RoleBuild and optimize Databricks pipelines (PySpark, SQL, Delta Lake) that transform Raw data into curated and business-ready layers. Own production deployments through Azure DevOps (ADO), including code reviews, testing, and releases; track work in ADO Boards. Monitor, troubleshoot, and tune jobs for performance, reliability, and cost. Implement data quality checks and governance using Unity Catalog. Partner with business users and the Platform team to turn requirements into technical solutions. Maintain clear documentation and support runbooks.ResponsibilitiesBuild and optimize Databricks pipelines (PySpark, SQL, Delta Lake) that transform Raw data into curated and business-ready layers.Own production deployments through Azure DevOps (ADO), including code reviews, testing, and releases; track work in ADO Boards.Monitor, troubleshoot, and tune jobs for performance, reliability, and cost.Implement data quality checks and governance using Unity Catalog.Partner with business users and the Platform team to turn requirements into technical solutions.Maintain clear documentation and support runbooks.Required SkillsStrong hands-on experience with Databricks (notebooks, jobs, workflows, clusters).Proficiency in PySpark, Python, and advanced SQL.Solid understanding of Delta Lake, data modeling, and ETL/ELT patterns.Experience supporting production workloads, with strong debugging and data validation skills.Working knowledge of Git and CI/CD, ideally Azure DevOps (Repos, Pipelines, Boards).","company":"Topcoder","rawCompany":"topcoder","city":"California","state":"MO","isRemote":false,"isActive":false,"createdAt":"2026-10-28T10:10:00.269Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer","description":"About the RoleBuild and optimize Databricks pipelines (PySpark, SQL, Delta Lake) that transform Raw data into curated and business-ready layers. Own production deployments through Azure DevOps (ADO), including code reviews, testing, and releases; track work in ADO Boards. Monitor, troubleshoot, and tune jobs for performance, reliability, and cost. Implement data quality checks and governance using Unity Catalog. Partner with business users and the Platform team to turn requirements into technical solutions. Maintain clear documentation and support runbooks.ResponsibilitiesBuild and optimize Databricks pipelines (PySpark, SQL, Delta Lake) that transform Raw data into curated and business-ready layers.Own production deployments through Azure DevOps (ADO), including code reviews, testing, and releases; track work in ADO Boards.Monitor, troubleshoot, and tune jobs for performance, reliability, and cost.Implement data quality checks and governance using Unity Catalog.Partner with business users and the Platform team to turn requirements into technical solutions.Maintain clear documentation and support runbooks.Required SkillsStrong hands-on experience with Databricks (notebooks, jobs, workflows, clusters).Proficiency in PySpark, Python, and advanced SQL.Solid understanding of Delta Lake, data modeling, and ETL/ELT patterns.Experience supporting production workloads, with strong debugging and data validation skills.Working knowledge of Git and CI/CD, ideally Azure DevOps (Repos, Pipelines, Boards).","datePosted":"2026-10-28T10:10:00.269Z","dateModified":"2026-10-28T10:10:00.269Z","hiringOrganization":{"@type":"Organization","name":"Topcoder","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"California","addressRegion":"MO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"a52129433df5c401f5d4d571"},"url":"https://jobsearcher.com/jobs/a52129433df5c401f5d4d571"}}