{"schemaVersion":"jobsearcher.job.v1","id":"d15ffaba823609b126739b8b","url":"https://jobsearcher.com/jobs/d15ffaba823609b126739b8b","canonicalUrl":"https://jobsearcher.com/jobs/d15ffaba823609b126739b8b","title":"Sr. Databricks Engineer","description":"Title: Sr. Databricks Engineer\n\nLocation: Remote in USA\n\nWorking hours in EST\n\nRequired certification: Databricks Data Engineer Professional\n\nRole Summary\nThe Senior Data Engineer is responsible for the end-to-end data lifecycle, including the analysis, design, and implementation of data solutions on the Databricks Data Intelligence Platform running on Microsoft Azure, AWS or GCP. The role leverages Databricks, Python, PySpark, and SQL to deliver data ingestion, transformation, modeling, and pipeline orchestration.\n\nAs the senior engineer, this role leads solution design, sets engineering standards for how pipelines are built, governed, and deployed, and guides other data engineers.\n\nResponsibilities\n\nDesign, develop, and maintain robust batch and streaming data pipelines for extracting, transforming, and loading (ETL/ELT) data from multiple sources into the Databricks lakehouse on Azure.\nAutomate and streamline data ingestion using Auto Loader, Lakeflow Connect, and Azure services such as Azure Data Factory and Event Hubs.\nBuild and manage pipelines with Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables), including data quality expectations and change data capture.\nPerform complex data manipulation and transformation using PySpark and Spark SQL, ensuring data is prepared for advanced analytics, reporting, and AI/ML use cases.\nDesign and implement orchestration and scheduling of data workflows with Lakeflow Jobs (formerly Databricks Workflows) to ensure reliability and efficiency.\nDesign and implement scalable data models within the lakehouse using medallion architecture (bronze/silver/gold) and dimensional modeling, including SCD Type 1 and Type 2.\nImplement data governance and security in Unity Catalog, including access controls, lineage, and row filters and column masks for sensitive data.\nOptimize performance and cost across Delta tables, Spark workloads, serverless and classic compute, and SQL warehouses.\nEstablish CI/CD and testing practices for data pipelines using Git folders, Declarative Automation Bundles (formerly Databricks Asset Bundles), and Azure DevOps or GitHub Actions.\nMonitor pipeline health and data quality using system tables and data quality monitoring; lead root-cause analysis and resolution of production issues.\nLead design and code reviews, define engineering standards, and mentor data engineers on the team.\nCollaborate with cross-functional teams, including business stakeholders and IT, to ensure data solutions meet business and performance requirements aligned to project goals.\n\nRequired Qualifications\n\nExperience\n\n10+ years of professional experience in data engineering, data & analytics, or data warehousing.\n5+ years of hands-on experience working with Databricks in a data engineering capacity, including production workloads.\n5+ years of experience with Python, including manipulating large datasets using PySpark DataFrames, Spark SQL, and/or the pandas API on Spark.\n3+ years of data engineering experience on Microsoft Azure (e.g., ADLS Gen2, Azure Data Factory, Key Vault, Microsoft Entra ID).\n\nSkills and Knowledge\n\nExpert proficiency in Python and SQL for data engineering, data modeling, transformation, and querying.\nDeep knowledge of Delta Lake and Spark performance tuning, including liquid clustering, OPTIMIZE/VACUUM, predictive optimization, partitioning, data skew, and Photon.\nHands-on experience with Unity Catalog for data governance, security, and lineage.\nExperience implementing streaming data ingestion in Databricks using Structured Streaming, Auto Loader, and Event Hubs or Kafka.\nStrong understanding of testing and deployment strategies for data pipelines, including unit testing, CI/CD, and productionizing ETL pipelines and Databricks SQL queries.\nExperience enabling BI consumption through Databricks SQL warehouses and tools such as Power BI.\n\nEducation\n\nBachelor’s degree in computer science, Information Systems, Data Engineering, or a closely related field, or equivalent professional experience.\n\nPreferred Qualifications\n\nActive Databricks Certified Data Engineer Professional certification.\nActive Databricks Certified Data Engineer Associate certification.\nExperience with healthcare data (e.g., claims, EHR/clinical data, HL7/FHIR) and HIPAA/PHI handling.\nInfrastructure as code experience with Terraform (Databricks and Azure providers).\nExperience preparing data for machine learning and generative AI use cases.\nFamiliarity with Delta Sharing and Lakehouse Federation.\n\nThe base salary for this position is $106,087 to $140,000 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.\n\nWe accept applications for this position on an ongoing basis. It is currently for an existing, immediate vacancy; however, we are also considering applications for future opportunities as they arise. We encourage all interested candidates to apply.\n\nAs part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role. Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law. If biometric identifiers or biometric information are collected, used, or stored, the Company will provide the legally required disclosures and obtain any required written consent prior to such collection, and will handle such information in accordance with applicable biometric privacy laws and Company policies.\n\n#Remoterole\n\n#Concentrix\n\n#USA\n\nPhysical and Mental Requirements:\n\nThe employee is regularly required to operate a computer, keyboard, telephone/headset, and/or other office equipment as essential functions of this position. Work is generally sedentary in nature.\n\nEqual Employment Opportunity:\n\nConcentrix is an equal opportunity and affirmative action (EEO-AA) employer. We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law.\n\nFor more information regarding your EEO rights as an applicant, please visit the following websites:\n\n· English\n\n· Spanish\n\nAccommodation:\n\nConcentrix welcomes and encourages applications from candidates with disabilities and is committed to providing an inclusive recruitment process. If you require reasonable accommodation to participate in any stage of the application or interview process, please let us know. Requests may be made by contacting app.acco@concentrix.com. All information will be treated confidentially and used solely to facilitate your participation in the recruitment process.\n\nArtificial Intelligence:\n\nAs part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants. These tools could be used to evaluate resumes, applications, and other materials submitted to help us identify the best candidates for the role.\n\nWork Authorization:\n\nIn accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position. Must reside in the United States or have a valid U.S. address for residence.\n\nFor further information on available work states and Equal Employment Opportunity as an applicant, please click HERE","company":"Concentrix","rawCompany":"concentrix","city":"Austin","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-10-05T01:27:11.431Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Sr. Databricks Engineer","description":"Title: Sr. Databricks Engineer\n\nLocation: Remote in USA\n\nWorking hours in EST\n\nRequired certification: Databricks Data Engineer Professional\n\nRole Summary\nThe Senior Data Engineer is responsible for the end-to-end data lifecycle, including the analysis, design, and implementation of data solutions on the Databricks Data Intelligence Platform running on Microsoft Azure, AWS or GCP. The role leverages Databricks, Python, PySpark, and SQL to deliver data ingestion, transformation, modeling, and pipeline orchestration.\n\nAs the senior engineer, this role leads solution design, sets engineering standards for how pipelines are built, governed, and deployed, and guides other data engineers.\n\nResponsibilities\n\nDesign, develop, and maintain robust batch and streaming data pipelines for extracting, transforming, and loading (ETL/ELT) data from multiple sources into the Databricks lakehouse on Azure.\nAutomate and streamline data ingestion using Auto Loader, Lakeflow Connect, and Azure services such as Azure Data Factory and Event Hubs.\nBuild and manage pipelines with Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables), including data quality expectations and change data capture.\nPerform complex data manipulation and transformation using PySpark and Spark SQL, ensuring data is prepared for advanced analytics, reporting, and AI/ML use cases.\nDesign and implement orchestration and scheduling of data workflows with Lakeflow Jobs (formerly Databricks Workflows) to ensure reliability and efficiency.\nDesign and implement scalable data models within the lakehouse using medallion architecture (bronze/silver/gold) and dimensional modeling, including SCD Type 1 and Type 2.\nImplement data governance and security in Unity Catalog, including access controls, lineage, and row filters and column masks for sensitive data.\nOptimize performance and cost across Delta tables, Spark workloads, serverless and classic compute, and SQL warehouses.\nEstablish CI/CD and testing practices for data pipelines using Git folders, Declarative Automation Bundles (formerly Databricks Asset Bundles), and Azure DevOps or GitHub Actions.\nMonitor pipeline health and data quality using system tables and data quality monitoring; lead root-cause analysis and resolution of production issues.\nLead design and code reviews, define engineering standards, and mentor data engineers on the team.\nCollaborate with cross-functional teams, including business stakeholders and IT, to ensure data solutions meet business and performance requirements aligned to project goals.\n\nRequired Qualifications\n\nExperience\n\n10+ years of professional experience in data engineering, data & analytics, or data warehousing.\n5+ years of hands-on experience working with Databricks in a data engineering capacity, including production workloads.\n5+ years of experience with Python, including manipulating large datasets using PySpark DataFrames, Spark SQL, and/or the pandas API on Spark.\n3+ years of data engineering experience on Microsoft Azure (e.g., ADLS Gen2, Azure Data Factory, Key Vault, Microsoft Entra ID).\n\nSkills and Knowledge\n\nExpert proficiency in Python and SQL for data engineering, data modeling, transformation, and querying.\nDeep knowledge of Delta Lake and Spark performance tuning, including liquid clustering, OPTIMIZE/VACUUM, predictive optimization, partitioning, data skew, and Photon.\nHands-on experience with Unity Catalog for data governance, security, and lineage.\nExperience implementing streaming data ingestion in Databricks using Structured Streaming, Auto Loader, and Event Hubs or Kafka.\nStrong understanding of testing and deployment strategies for data pipelines, including unit testing, CI/CD, and productionizing ETL pipelines and Databricks SQL queries.\nExperience enabling BI consumption through Databricks SQL warehouses and tools such as Power BI.\n\nEducation\n\nBachelor’s degree in computer science, Information Systems, Data Engineering, or a closely related field, or equivalent professional experience.\n\nPreferred Qualifications\n\nActive Databricks Certified Data Engineer Professional certification.\nActive Databricks Certified Data Engineer Associate certification.\nExperience with healthcare data (e.g., claims, EHR/clinical data, HL7/FHIR) and HIPAA/PHI handling.\nInfrastructure as code experience with Terraform (Databricks and Azure providers).\nExperience preparing data for machine learning and generative AI use cases.\nFamiliarity with Delta Sharing and Lakehouse Federation.\n\nThe base salary for this position is $106,087 to $140,000 plus incentives that align with individual and company performance. Actual salaries will vary based on work location, qualifications, skills, education, experience, and competencies. Benefits available to eligible employees in this role include medical, dental, and vision insurance, comprehensive employee assistance program, 401(k) retirement plan, paid time off and holidays and paid learning days.\n\nWe accept applications for this position on an ongoing basis. It is currently for an existing, immediate vacancy; however, we are also considering applications for future opportunities as they arise. We encourage all interested candidates to apply.\n\nAs part of the hiring process, candidates may be required to undergo background screening and identity verification, where permitted by applicable law and consistent with the requirements of the role. Certain verification processes used by the Company or its service providers may involve technologies that rely on biometric identifiers or biometric information, where permitted by law. If biometric identifiers or biometric information are collected, used, or stored, the Company will provide the legally required disclosures and obtain any required written consent prior to such collection, and will handle such information in accordance with applicable biometric privacy laws and Company policies.\n\n#Remoterole\n\n#Concentrix\n\n#USA\n\nPhysical and Mental Requirements:\n\nThe employee is regularly required to operate a computer, keyboard, telephone/headset, and/or other office equipment as essential functions of this position. Work is generally sedentary in nature.\n\nEqual Employment Opportunity:\n\nConcentrix is an equal opportunity and affirmative action (EEO-AA) employer. We promote equal opportunity to all qualified individuals and do not discriminate in any phase of the employment process based on race, color, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy or related condition, disability, status as a protected veteran, or any other basis protected by law.\n\nFor more information regarding your EEO rights as an applicant, please visit the following websites:\n\n· English\n\n· Spanish\n\nAccommodation:\n\nConcentrix welcomes and encourages applications from candidates with disabilities and is committed to providing an inclusive recruitment process. If you require reasonable accommodation to participate in any stage of the application or interview process, please let us know. Requests may be made by contacting app.acco@concentrix.com. All information will be treated confidentially and used solely to facilitate your participation in the recruitment process.\n\nArtificial Intelligence:\n\nAs part of our recruitment process, we may use artificial intelligence (AI) tools to assist in the screening and/or assessment of job applicants. These tools could be used to evaluate resumes, applications, and other materials submitted to help us identify the best candidates for the role.\n\nWork Authorization:\n\nIn accordance with federal law, only applicants who are legally authorized to work in the United States will be considered for this position. Must reside in the United States or have a valid U.S. address for residence.\n\nFor further information on available work states and Equal Employment Opportunity as an applicant, please click HERE","datePosted":"2026-10-05T01:27:11.431Z","dateModified":"2026-10-05T01:27:11.431Z","hiringOrganization":{"@type":"Organization","name":"Concentrix","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Austin","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"d15ffaba823609b126739b8b"},"url":"https://jobsearcher.com/jobs/d15ffaba823609b126739b8b"}}