{"schemaVersion":"jobsearcher.job.v1","id":"18edec8a3e9ae7cf8c54ff58","url":"https://jobsearcher.com/jobs/18edec8a3e9ae7cf8c54ff58","canonicalUrl":"https://jobsearcher.com/jobs/18edec8a3e9ae7cf8c54ff58","title":"Databricks Data Engineer","description":"The Databricks Data Engineer will be responsible for designing, developing, and maintaining data ingestion and transformation pipelines within a Databricks Lakehouse environment. This role focuses on integrating data from multiple source systems, implementing scalable data architectures, and preparing high-quality datasets for downstream analytics and reporting. The ideal candidate will have strong experience with Databricks, Spark, Python, SQL, and modern data engineering practices.\r\nKey Responsibilities\r\nDevelop and maintain data ingestion pipelines that integrate data from multiple source systems.\r\nDesign, build, and optimize ETL/ELT pipelines using Databricks, PySpark, and SQL.\r\nImplement and support Medallion Architecture layers, including Bronze, Silver, and Gold data models.\r\nEnsure data quality, validation, and consistency across data pipelines and datasets.\r\nMonitor, troubleshoot, and resolve data pipeline execution issues.\r\nOptimize pipeline performance, scalability, and reliability to support enterprise data workloads.\r\nWork with structured and semi-structured data formats from diverse source systems.\r\nSupport data transformation, cleansing, enrichment, and integration activities.\r\nCollaborate with data analysts, data scientists, and business stakeholders to support analytics requirements.\r\nMaintain technical documentation related to data pipelines, architectures, and processes.\r\nFollow data engineering best practices for performance, security, governance, and operational support.\r\nParticipate in code reviews, testing, and continuous improvement initiatives.\r\nRequired Qualifications\r\n6+ years of experience in Data Engineering.\r\nHands-on experience with Databricks and Apache Spark.\r\nStrong programming experience with Python.\r\nStrong SQL development and query optimization skills.\r\nExperience designing, developing, and maintaining ETL/ELT pipelines.\r\nExperience implementing and supporting Delta Lake architectures.\r\nUnderstanding of distributed data processing systems and large-scale data platforms.\r\nExperience working with structured and semi-structured data formats.\r\nStrong troubleshooting, performance tuning, and problem-solving skills.\r\nExperience monitoring and supporting production data pipelines.\r\nAbility to work effectively in a collaborative team environment.\r\nStrong communication and documentation skills.\r\nPreferred Qualifications\r\nExperience implementing Medallion Architecture (Bronze, Silver, Gold) within Databricks environments.\r\nExperience working with cloud-based data platforms and modern data lake architectures.\r\nExperience supporting enterprise analytics, reporting, and business intelligence initiatives.\r\nKnowledge of data governance, data quality, and data lifecycle management best practices.\r\nJ-18808-Ljbffr","company":"Compunnel","rawCompany":"compunnel","city":"Spring","state":"TX","isRemote":false,"isActive":false,"createdAt":"2026-07-04T02:16:26.880Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Data Engineer","description":"The Databricks Data Engineer will be responsible for designing, developing, and maintaining data ingestion and transformation pipelines within a Databricks Lakehouse environment. This role focuses on integrating data from multiple source systems, implementing scalable data architectures, and preparing high-quality datasets for downstream analytics and reporting. The ideal candidate will have strong experience with Databricks, Spark, Python, SQL, and modern data engineering practices.\r\nKey Responsibilities\r\nDevelop and maintain data ingestion pipelines that integrate data from multiple source systems.\r\nDesign, build, and optimize ETL/ELT pipelines using Databricks, PySpark, and SQL.\r\nImplement and support Medallion Architecture layers, including Bronze, Silver, and Gold data models.\r\nEnsure data quality, validation, and consistency across data pipelines and datasets.\r\nMonitor, troubleshoot, and resolve data pipeline execution issues.\r\nOptimize pipeline performance, scalability, and reliability to support enterprise data workloads.\r\nWork with structured and semi-structured data formats from diverse source systems.\r\nSupport data transformation, cleansing, enrichment, and integration activities.\r\nCollaborate with data analysts, data scientists, and business stakeholders to support analytics requirements.\r\nMaintain technical documentation related to data pipelines, architectures, and processes.\r\nFollow data engineering best practices for performance, security, governance, and operational support.\r\nParticipate in code reviews, testing, and continuous improvement initiatives.\r\nRequired Qualifications\r\n6+ years of experience in Data Engineering.\r\nHands-on experience with Databricks and Apache Spark.\r\nStrong programming experience with Python.\r\nStrong SQL development and query optimization skills.\r\nExperience designing, developing, and maintaining ETL/ELT pipelines.\r\nExperience implementing and supporting Delta Lake architectures.\r\nUnderstanding of distributed data processing systems and large-scale data platforms.\r\nExperience working with structured and semi-structured data formats.\r\nStrong troubleshooting, performance tuning, and problem-solving skills.\r\nExperience monitoring and supporting production data pipelines.\r\nAbility to work effectively in a collaborative team environment.\r\nStrong communication and documentation skills.\r\nPreferred Qualifications\r\nExperience implementing Medallion Architecture (Bronze, Silver, Gold) within Databricks environments.\r\nExperience working with cloud-based data platforms and modern data lake architectures.\r\nExperience supporting enterprise analytics, reporting, and business intelligence initiatives.\r\nKnowledge of data governance, data quality, and data lifecycle management best practices.\r\nJ-18808-Ljbffr","datePosted":"2026-07-04T02:16:26.880Z","dateModified":"2026-07-04T02:16:26.880Z","hiringOrganization":{"@type":"Organization","name":"Compunnel","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Spring","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"18edec8a3e9ae7cf8c54ff58"},"url":"https://jobsearcher.com/jobs/18edec8a3e9ae7cf8c54ff58"}}