{"schemaVersion":"jobsearcher.job.v1","id":"82e0b81b7d1d43916209de53","url":"https://jobsearcher.com/jobs/82e0b81b7d1d43916209de53","canonicalUrl":"https://jobsearcher.com/jobs/82e0b81b7d1d43916209de53","title":"DataBricks Data Engineer","description":"Overview:\n\nProdapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.\n\nWe are seeking an experienced Azure Databricks Engineer to join our team in Dallas, TX. The ideal candidate has strong hands-on experience in designing and building scalable data engineering solutions using Azure Databricks, PySpark, Python, SQL, and Azure Data Services including leading the modernization and migration of existing Python object-oriented applications into scalable PySpark and Spark SQL data-processing solutions on Azure Databricks.\n\nResponsibilities:\n\nDesign, develop, and implement scalable data pipelines using Azure Databricks.\nBuild and optimize ETL/ELT pipelines using PySpark, Python, and SQL.\nDevelop data solutions using the Medallion Architecture (Bronze, Silver, and Gold layers).\nWork with Delta Lake, Delta tables, and advanced Databricks optimization techniques.\nIntegrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Azure Synapse, and Azure Key Vault.\nDevelop and manage Databricks Workflows, Jobs, and Notebooks.\nImplement data quality, monitoring, error handling, and performance optimization.\nCollaborate with Data Architects, Data Engineers, Data Scientists, and business stakeholders.\nEstablish best practices for CI/CD, Git/version control, code reviews, and automated deployments.\nLead technical discussions and provide guidance to junior engineers.\nAnalyze existing Python OOP applications and redesign single-node processing logic for distributed Spark execution.\nDesign, develop, and deploy enterprise-scale data pipelines on Azure Databricks; build reusable PySpark frameworks and utility modules.\nImplement Delta Lake solutions using the Bronze, Silver, Gold architecture.\nBuild robust ETL/ELT pipelines with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics.\nImplement data quality, reconciliation, validation, and monitoring frameworks.\nOptimize Spark jobs using partitioning, bucketing, caching, broadcast joins, Adaptive Query Execution, and Delta optimization.\n\nRequirements:\n\n10+ years of overall Data Engineering experience, including designing and implementing ETL/ELT pipelines with Azure Data Factory and other Azure services.\n\nBachelor’s degree in Computer Science, Engineering, or a related field; OR equivalent combination of education and relevant experience.\nStrong hands-on experience with Azure Databricks; 4+ years of experience across Azure services and Databricks (ADLS, ADF, Azure DevOps, etc.).\n7+ years of Python development experience, with the ability to design and build reusable libraries.\n4+ years of experience with Snowflake or SQL (No-SQL experience is a plus).\nExpert-level knowledge of PySpark and Spark SQL.\nStrong programming experience in Python and SQL.\nExperience with Delta Lake and Lakehouse architecture.\nStrong experience with Azure Data Lake Storage (ADLS Gen2).\nExperience with Azure Data Factory (ADF) and other Azure data services.\nStrong understanding of ETL/ELT, data modeling, and large-scale data pipelines.\nExperience with performance tuning and optimization in Databricks/Spark.\nExperience with Git, CI/CD, and DevOps practices.\n\nPreferred Skills\nDatabricks certifications.\nExperience with Unity Catalog and Databricks governance/security.\nExperience with Terraform or Infrastructure as Code.\nKnowledge of Azure DevOps.\nExperience designing APIs and integrating with React JS within a cloud platform","company":"Prodapt","rawCompany":"prodapt","city":"Irving","state":"TX","isRemote":false,"isActive":true,"createdAt":"2026-09-06T14:00:37.251Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"DataBricks Data Engineer","description":"Overview:\n\nProdapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A “Great Place To Work® Certified™” company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.\n\nWe are seeking an experienced Azure Databricks Engineer to join our team in Dallas, TX. The ideal candidate has strong hands-on experience in designing and building scalable data engineering solutions using Azure Databricks, PySpark, Python, SQL, and Azure Data Services including leading the modernization and migration of existing Python object-oriented applications into scalable PySpark and Spark SQL data-processing solutions on Azure Databricks.\n\nResponsibilities:\n\nDesign, develop, and implement scalable data pipelines using Azure Databricks.\nBuild and optimize ETL/ELT pipelines using PySpark, Python, and SQL.\nDevelop data solutions using the Medallion Architecture (Bronze, Silver, and Gold layers).\nWork with Delta Lake, Delta tables, and advanced Databricks optimization techniques.\nIntegrate Databricks with Azure services such as ADLS Gen2, Azure Data Factory, Azure Synapse, and Azure Key Vault.\nDevelop and manage Databricks Workflows, Jobs, and Notebooks.\nImplement data quality, monitoring, error handling, and performance optimization.\nCollaborate with Data Architects, Data Engineers, Data Scientists, and business stakeholders.\nEstablish best practices for CI/CD, Git/version control, code reviews, and automated deployments.\nLead technical discussions and provide guidance to junior engineers.\nAnalyze existing Python OOP applications and redesign single-node processing logic for distributed Spark execution.\nDesign, develop, and deploy enterprise-scale data pipelines on Azure Databricks; build reusable PySpark frameworks and utility modules.\nImplement Delta Lake solutions using the Bronze, Silver, Gold architecture.\nBuild robust ETL/ELT pipelines with Azure Data Factory, ADLS Gen2, and Azure Synapse Analytics.\nImplement data quality, reconciliation, validation, and monitoring frameworks.\nOptimize Spark jobs using partitioning, bucketing, caching, broadcast joins, Adaptive Query Execution, and Delta optimization.\n\nRequirements:\n\n10+ years of overall Data Engineering experience, including designing and implementing ETL/ELT pipelines with Azure Data Factory and other Azure services.\n\nBachelor’s degree in Computer Science, Engineering, or a related field; OR equivalent combination of education and relevant experience.\nStrong hands-on experience with Azure Databricks; 4+ years of experience across Azure services and Databricks (ADLS, ADF, Azure DevOps, etc.).\n7+ years of Python development experience, with the ability to design and build reusable libraries.\n4+ years of experience with Snowflake or SQL (No-SQL experience is a plus).\nExpert-level knowledge of PySpark and Spark SQL.\nStrong programming experience in Python and SQL.\nExperience with Delta Lake and Lakehouse architecture.\nStrong experience with Azure Data Lake Storage (ADLS Gen2).\nExperience with Azure Data Factory (ADF) and other Azure data services.\nStrong understanding of ETL/ELT, data modeling, and large-scale data pipelines.\nExperience with performance tuning and optimization in Databricks/Spark.\nExperience with Git, CI/CD, and DevOps practices.\n\nPreferred Skills\nDatabricks certifications.\nExperience with Unity Catalog and Databricks governance/security.\nExperience with Terraform or Infrastructure as Code.\nKnowledge of Azure DevOps.\nExperience designing APIs and integrating with React JS within a cloud platform","datePosted":"2026-09-06T14:00:37.251Z","dateModified":"2026-09-06T14:00:37.251Z","hiringOrganization":{"@type":"Organization","name":"Prodapt","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Irving","addressRegion":"TX","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"82e0b81b7d1d43916209de53"},"url":"https://jobsearcher.com/jobs/82e0b81b7d1d43916209de53"}}