{"schemaVersion":"jobsearcher.job.v1","id":"2c4632ccb412aa6ab9909ecb","url":"https://jobsearcher.com/jobs/2c4632ccb412aa6ab9909ecb","canonicalUrl":"https://jobsearcher.com/jobs/2c4632ccb412aa6ab9909ecb","title":"Databricks Engineer","description":"Senior Databricks Engineer (Contract)Location: RemoteIndustry: UtilitiesEmployment Type: 12 month ContractA Fortune 500 utilities organization is seeking an experienced Databricks Engineer to support a major Customer Platform Modernization initiative built around the Databricks Lakehouse Platform.This is an exciting opportunity to contribute to a significant enterprise data transformation, modernizing the organization's customer data infrastructure and developing scalable data solutions to support improved customer experiences, operational efficiency, and advanced analytics.The successful candidate will play a hands-on role in designing, developing, and optimizing data pipelines and integration frameworks that bring together customer information from multiple legacy and enterprise systems. Working closely with Data Architects, Data Engineers, Enterprise Technology teams, and business stakeholders, this individual will help establish a modern, unified data environment capable of supporting the organization's evolving customer platform requirements.We are specifically seeking a hands-on Databricks Engineer with strong expertise in Apache Spark, PySpark, Python, SQL, and Delta Lake. The ideal candidate will have experience developing production-grade data pipelines, integrating complex enterprise systems, and delivering scalable Lakehouse solutions within large-scale cloud environments.Key ResponsibilitiesDesign, develop, and maintain enterprise-scale data engineering solutions using the Databricks Lakehouse PlatformSupport the modernization of the organization's existing customer data platform, migrating legacy data infrastructure and integration processes into DatabricksBuild and optimize complex ETL/ELT pipelines using Python, PySpark, Spark SQL, and Delta LakeDevelop scalable data ingestion frameworks to integrate customer information from multiple internal and external enterprise systemsConsolidate and transform customer data from disparate legacy platforms into a consistent, unified data environmentDesign and implement data models supporting customer profiles, account information, service interactions, billing, usage, and customer lifecycle managementDevelop robust data transformation, cleansing, validation, and enrichment processes to improve customer data quality and consistencyDesign and develop Lakehouse architectures utilizing Delta Lake and Bronze, Silver, and Gold data layersBuild and maintain batch and real-time streaming data pipelines using Apache Spark and Databricks technologiesDevelop and optimize Delta Lake tables, including partitioning, schema evolution, and performance tuning strategiesImplement and manage data workflows using Databricks Workflows, Delta Live Tables, and related orchestration technologiesWork with Databricks Unity Catalog to establish data governance, access controls, security, and metadata managementIntegrate Databricks with existing customer platforms, CRM systems, billing applications, enterprise applications, and downstream data consumersOptimize Spark jobs, SQL queries, and data processing workloads to improve platform performance, scalability, and cloud cost efficiencyDevelop reusable data engineering frameworks, libraries, and coding standards to improve development efficiencyImplement CI/CD pipelines, version control, and Infrastructure-as-Code practices to support reliable platform deploymentsCollaborate with Data Architects, Analytics teams, and business stakeholders to translate customer platform requirements into scalable technical solutionsEnsure customer data solutions meet enterprise security, privacy, regulatory, governance, and data quality requirementsTroubleshoot complex data pipeline failures, performance bottlenecks, and integration challenges across enterprise environmentsSupport production deployments, platform enhancements, and ongoing operational improvementsContribute to the development of a modern customer data foundation supporting advanced analytics, customer insights, personalization, and AI-driven initiativesRequired Qualifications5+ years of experience in Data Engineering, Software Engineering, or a related technical discipline2+ years of hands-on experience developing solutions using DatabricksStrong proficiency in Python, PySpark, and SQLExtensive experience with Apache Spark and distributed data processingProven experience designing, developing, and maintaining production-grade ETL/ELT data pipelinesStrong understanding of Databricks Lakehouse architecture and Delta LakeExperience implementing data ingestion, transformation, and processing frameworks across complex enterprise environmentsHands-on experience with Delta Lake, including Delta tables, schema evolution, and optimization techniquesExperience working with cloud platforms, particularly Microsoft Azure, AWS, or Google Cloud PlatformStrong understanding of data warehousing, data modelling, and modern data architecture principlesExperience developing batch processing and, ideally, real-time streaming solutionsFamiliarity with data orchestration, workflow automation, and production pipeline monitoringUnderstanding of data governance, security, access controls, and data quality frameworksExperience with Git, CI/CD pipelines, and modern software development practicesExperience integrating data from multiple enterprise applications and legacy systemsUnderstanding of customer data structures, customer information management, and enterprise data integrationStrong analytical and problem-solving skills, with the ability to troubleshoot complex engineering challengesExcellent communication skills and the ability to collaborate effectively with technical and non-technical stakeholdersPreferred QualificationsDatabricks Certified Data Engineer Associate or Professional certificationExperience with Databricks Unity Catalog, Delta Live Tables, and Databricks WorkflowsExperience implementing Medallion Architecture and enterprise Lakehouse solutionsKnowledge of Databricks Asset Bundles and automated deployment frameworksExperience with Databricks SQL and developing optimized analytical workloadsFamiliarity with MLflow, Feature Store, and machine learning operationalizationExperience supporting Generative AI, Large Language Models (LLMs), and AI-driven data solutionsKnowledge of cloud-native data services, including Azure Data Factory, AWS Glue, S3, ADLS, and related technologiesExperience with Terraform, Infrastructure-as-Code, and cloud platform automationFamiliarity with dbt, Airflow, Kafka, Fivetran, or other modern data engineering technologiesExperience migrating legacy customer platforms, data warehouses, CRM environments, or traditional ETL frameworks to DatabricksExperience integrating CRM, customer billing, customer relationship management, and enterprise operational systemsPrevious experience within the utilities, energy, power generation, transmission, distribution, or wider infrastructure sectorsUnderstanding of utilities customer data domains, including customer accounts, service connections, metering, billing, energy consumption, and customer interactionsExperience working within Fortune 500 organizations or other highly complex enterprise environmentsProject ContextThe organization is undertaking a significant Customer Platform Modernization initiative, leveraging Databricks to transform how customer data is integrated, managed, and made available across the enterprise.As a Fortune 500 utilities business, the organization manages substantial volumes of customer information across multiple legacy platforms, billing systems, customer applications, and operational databases.The project is focused on modernizing this existing customer data infrastructure by bringing disparate data sources together within Databricks, establishing consistent data models, and developing scalable ingestion and transformation pipelines.The objective is to create a more unified and reliable customer data foundation that supports improved customer visibility, more efficient business processes, and enhanced analytical capabilities.The successful candidate will contribute to building and optimizing this modern data environment, working across the full data engineering lifecycle from ingestion and transformation through to data modelling, governance, and downstream consumption.Key areas of focus include:Customer data integration and consolidation across legacy enterprise systemsModernization of existing customer data pipelines and ETL processesDevelopment of scalable customer data models and Lakehouse architectureImproving customer data quality, consistency, and accessibilitySupporting customer analytics, reporting, and operational applicationsEstablishing a reliable data foundation for future digital transformation and AI initiativesPrevious utilities or energy sector experience is advantageous but not essential. The priority is demonstrable Databricks engineering capability, strong technical fundamentals, and experience delivering enterprise-scale data modernization solutions.What We're Looking ForWe are seeking a hands-on Databricks Engineer who combines strong technical expertise with practical experience delivering enterprise data engineering and modernization projects.The ideal candidate will have a proven track record of building production-grade pipelines, integrating complex enterprise systems, developing robust data models, and optimizing distributed data processing workloads.You should be comfortable working within a large enterprise technology environment, collaborating with multiple engineering teams, and translating business requirements into scalable technical solutions.We are particularly interested in engineers who understand Databricks beyond simply using it as a development environment and can demonstrate genuine experience building, optimizing, and supporting solutions on the platform.Candidates with strong PySpark, Python, SQL, Spark, and Delta Lake experience, alongside exposure to customer data platforms, enterprise integrations, and legacy modernization initiatives, will be particularly relevant.Experience within utilities, energy, or other highly regulated infrastructure environments would be beneficial, particularly where candidates have worked on large-scale customer data or platform transformation projects.If you are interested in learning more about this opportunity, please apply directly or contact us for additional details.","company":"Xinova Group","rawCompany":"xinova group","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-11-05T07:57:42.438Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Engineer","description":"Senior Databricks Engineer (Contract)Location: RemoteIndustry: UtilitiesEmployment Type: 12 month ContractA Fortune 500 utilities organization is seeking an experienced Databricks Engineer to support a major Customer Platform Modernization initiative built around the Databricks Lakehouse Platform.This is an exciting opportunity to contribute to a significant enterprise data transformation, modernizing the organization's customer data infrastructure and developing scalable data solutions to support improved customer experiences, operational efficiency, and advanced analytics.The successful candidate will play a hands-on role in designing, developing, and optimizing data pipelines and integration frameworks that bring together customer information from multiple legacy and enterprise systems. Working closely with Data Architects, Data Engineers, Enterprise Technology teams, and business stakeholders, this individual will help establish a modern, unified data environment capable of supporting the organization's evolving customer platform requirements.We are specifically seeking a hands-on Databricks Engineer with strong expertise in Apache Spark, PySpark, Python, SQL, and Delta Lake. The ideal candidate will have experience developing production-grade data pipelines, integrating complex enterprise systems, and delivering scalable Lakehouse solutions within large-scale cloud environments.Key ResponsibilitiesDesign, develop, and maintain enterprise-scale data engineering solutions using the Databricks Lakehouse PlatformSupport the modernization of the organization's existing customer data platform, migrating legacy data infrastructure and integration processes into DatabricksBuild and optimize complex ETL/ELT pipelines using Python, PySpark, Spark SQL, and Delta LakeDevelop scalable data ingestion frameworks to integrate customer information from multiple internal and external enterprise systemsConsolidate and transform customer data from disparate legacy platforms into a consistent, unified data environmentDesign and implement data models supporting customer profiles, account information, service interactions, billing, usage, and customer lifecycle managementDevelop robust data transformation, cleansing, validation, and enrichment processes to improve customer data quality and consistencyDesign and develop Lakehouse architectures utilizing Delta Lake and Bronze, Silver, and Gold data layersBuild and maintain batch and real-time streaming data pipelines using Apache Spark and Databricks technologiesDevelop and optimize Delta Lake tables, including partitioning, schema evolution, and performance tuning strategiesImplement and manage data workflows using Databricks Workflows, Delta Live Tables, and related orchestration technologiesWork with Databricks Unity Catalog to establish data governance, access controls, security, and metadata managementIntegrate Databricks with existing customer platforms, CRM systems, billing applications, enterprise applications, and downstream data consumersOptimize Spark jobs, SQL queries, and data processing workloads to improve platform performance, scalability, and cloud cost efficiencyDevelop reusable data engineering frameworks, libraries, and coding standards to improve development efficiencyImplement CI/CD pipelines, version control, and Infrastructure-as-Code practices to support reliable platform deploymentsCollaborate with Data Architects, Analytics teams, and business stakeholders to translate customer platform requirements into scalable technical solutionsEnsure customer data solutions meet enterprise security, privacy, regulatory, governance, and data quality requirementsTroubleshoot complex data pipeline failures, performance bottlenecks, and integration challenges across enterprise environmentsSupport production deployments, platform enhancements, and ongoing operational improvementsContribute to the development of a modern customer data foundation supporting advanced analytics, customer insights, personalization, and AI-driven initiativesRequired Qualifications5+ years of experience in Data Engineering, Software Engineering, or a related technical discipline2+ years of hands-on experience developing solutions using DatabricksStrong proficiency in Python, PySpark, and SQLExtensive experience with Apache Spark and distributed data processingProven experience designing, developing, and maintaining production-grade ETL/ELT data pipelinesStrong understanding of Databricks Lakehouse architecture and Delta LakeExperience implementing data ingestion, transformation, and processing frameworks across complex enterprise environmentsHands-on experience with Delta Lake, including Delta tables, schema evolution, and optimization techniquesExperience working with cloud platforms, particularly Microsoft Azure, AWS, or Google Cloud PlatformStrong understanding of data warehousing, data modelling, and modern data architecture principlesExperience developing batch processing and, ideally, real-time streaming solutionsFamiliarity with data orchestration, workflow automation, and production pipeline monitoringUnderstanding of data governance, security, access controls, and data quality frameworksExperience with Git, CI/CD pipelines, and modern software development practicesExperience integrating data from multiple enterprise applications and legacy systemsUnderstanding of customer data structures, customer information management, and enterprise data integrationStrong analytical and problem-solving skills, with the ability to troubleshoot complex engineering challengesExcellent communication skills and the ability to collaborate effectively with technical and non-technical stakeholdersPreferred QualificationsDatabricks Certified Data Engineer Associate or Professional certificationExperience with Databricks Unity Catalog, Delta Live Tables, and Databricks WorkflowsExperience implementing Medallion Architecture and enterprise Lakehouse solutionsKnowledge of Databricks Asset Bundles and automated deployment frameworksExperience with Databricks SQL and developing optimized analytical workloadsFamiliarity with MLflow, Feature Store, and machine learning operationalizationExperience supporting Generative AI, Large Language Models (LLMs), and AI-driven data solutionsKnowledge of cloud-native data services, including Azure Data Factory, AWS Glue, S3, ADLS, and related technologiesExperience with Terraform, Infrastructure-as-Code, and cloud platform automationFamiliarity with dbt, Airflow, Kafka, Fivetran, or other modern data engineering technologiesExperience migrating legacy customer platforms, data warehouses, CRM environments, or traditional ETL frameworks to DatabricksExperience integrating CRM, customer billing, customer relationship management, and enterprise operational systemsPrevious experience within the utilities, energy, power generation, transmission, distribution, or wider infrastructure sectorsUnderstanding of utilities customer data domains, including customer accounts, service connections, metering, billing, energy consumption, and customer interactionsExperience working within Fortune 500 organizations or other highly complex enterprise environmentsProject ContextThe organization is undertaking a significant Customer Platform Modernization initiative, leveraging Databricks to transform how customer data is integrated, managed, and made available across the enterprise.As a Fortune 500 utilities business, the organization manages substantial volumes of customer information across multiple legacy platforms, billing systems, customer applications, and operational databases.The project is focused on modernizing this existing customer data infrastructure by bringing disparate data sources together within Databricks, establishing consistent data models, and developing scalable ingestion and transformation pipelines.The objective is to create a more unified and reliable customer data foundation that supports improved customer visibility, more efficient business processes, and enhanced analytical capabilities.The successful candidate will contribute to building and optimizing this modern data environment, working across the full data engineering lifecycle from ingestion and transformation through to data modelling, governance, and downstream consumption.Key areas of focus include:Customer data integration and consolidation across legacy enterprise systemsModernization of existing customer data pipelines and ETL processesDevelopment of scalable customer data models and Lakehouse architectureImproving customer data quality, consistency, and accessibilitySupporting customer analytics, reporting, and operational applicationsEstablishing a reliable data foundation for future digital transformation and AI initiativesPrevious utilities or energy sector experience is advantageous but not essential. The priority is demonstrable Databricks engineering capability, strong technical fundamentals, and experience delivering enterprise-scale data modernization solutions.What We're Looking ForWe are seeking a hands-on Databricks Engineer who combines strong technical expertise with practical experience delivering enterprise data engineering and modernization projects.The ideal candidate will have a proven track record of building production-grade pipelines, integrating complex enterprise systems, developing robust data models, and optimizing distributed data processing workloads.You should be comfortable working within a large enterprise technology environment, collaborating with multiple engineering teams, and translating business requirements into scalable technical solutions.We are particularly interested in engineers who understand Databricks beyond simply using it as a development environment and can demonstrate genuine experience building, optimizing, and supporting solutions on the platform.Candidates with strong PySpark, Python, SQL, Spark, and Delta Lake experience, alongside exposure to customer data platforms, enterprise integrations, and legacy modernization initiatives, will be particularly relevant.Experience within utilities, energy, or other highly regulated infrastructure environments would be beneficial, particularly where candidates have worked on large-scale customer data or platform transformation projects.If you are interested in learning more about this opportunity, please apply directly or contact us for additional details.","datePosted":"2026-11-05T07:57:42.438Z","dateModified":"2026-11-05T07:57:42.438Z","hiringOrganization":{"@type":"Organization","name":"Xinova Group","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"2c4632ccb412aa6ab9909ecb"},"url":"https://jobsearcher.com/jobs/2c4632ccb412aa6ab9909ecb"}}