JOBSEARCHER

Senior Databricks Engineers

Overview In this role you will design and deliver scalable data platforms on Databricks to empower analytics and operational decision-making. You will work within a healthcare analytics team to translate requirements into robust data solutions, supporting reporting and data-driven insights. Expect to lead architecture design, ensure data governance and security, and optimize performance and costs across cloud environments. This position offers a hands-on, impact-driven path at the intersection of data engineering and healthcare data architecture. You will stay current with Databricks capabilities to drive best practices and modernization efforts. ResponsibilitiesDesign and implement scalable data solutions using Databricks Lakehouse architectureDevelop and optimize batch and real-time data pipelines for large-scale data processingLead technical solution design for data integration, transformation, and analytics workloadsCollaborate with stakeholders to translate requirements into technical solutionsImplement data governance, security, and data quality best practices using Unity CatalogOptimize performance, reliability, and cost efficiency of Databricks workloadsSupport data warehouse modernization and cloud migration initiativesCreate architecture documentation, technical standards, and design guidelinesTroubleshoot complex data platform issues and provide technical recommendationsStay current with Databricks and cloud platform capabilities and drive adoption of best practices Key requirementsBachelor's degree in Computer Science, Information Systems, Engineering, or a related fieldMinimum 5 years of experience in data engineering, data architecture, or related technical rolesHands-on experience with Databricks in enterprise environmentsStrong knowledge of PySpark, Spark SQL, Python, and SQLExperience designing and implementing Lakehouse architecturesExperience building scalable ETL/ELT data pipelinesStrong understanding of data modeling, data warehousing, and analytics platformsExperience working with structured and unstructured dataStrong problem-solving and communication skillsAbility to work independently in a remote environmentExperience implementing data governance and security frameworkscommunicationproblem-solvingindependenceDatabricksUnity CatalogPySpark