{"schemaVersion":"jobsearcher.job.v1","id":"98eef0b050406375d27207b4","url":"https://jobsearcher.com/jobs/98eef0b050406375d27207b4","canonicalUrl":"https://jobsearcher.com/jobs/98eef0b050406375d27207b4","title":"Senior Databricks Developer","description":"HomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsHomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsJob DescriptionJob OverviewJob ID:J54834Job Title:Senior Databricks DeveloperLocation:Malvern, PADuration:12 Months + ExtensionDomain Exposure:Consumer StaplesClient:To Be Discussed LaterEmployment Type:W-2, 1099, C2CWork Authorization:US Citizen, Green Card, H-1B, OPT-EAD, CPT, OtherView All JobsSimilar JobsSenior GCP Platform Engineer - Woodland Hills, CASenior Snowflake Data Warehouse Engineer / Data Engineer - Madison, WISenior Full Stack Developer with React.js - Warren, MISalesforce Senior Business Analyst - Atlanta, GASenior SAP S/4HANA Functional Architect - Cincinnati, OHJob Title: Senior Databricks DeveloperLocation: Malvern, PADuration: 12 Months + ExtensionBill Rate: $81/hour (C2C)Job Type: W-2, 1099, C2CClient: To Be Discussed LaterWork Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, OtherJob SummaryWe are seeking a Senior Databricks Developer with 7+ years of Data Engineering experience and deep expertise in Databricks, AWS, PySpark, Python, and SQL. This is a highly technical, hands-on engineering role within a data engineering team focused primarily on building, enhancing, and supporting enterprise data pipelines. The ideal candidate will have extensive experience developing cloud-native data solutions in AWS, implementing Delta Lake and Medallion architectures, and delivering scalable, production-grade data pipelines using Databricks. This is not a consulting role; we are looking for a developer who enjoys building and optimizing data platforms and solving complex data engineering challenges.ResponsibilitiesDesign, develop, and maintain large-scale ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.Build scalable and highly reliable data ingestion, transformation, and orchestration frameworks within AWS.Develop and support Delta Lake implementations and Medallion Architecture (Bronze, Silver, Gold) data pipelines.Create and optimize batch and streaming pipelines that process large volumes of structured and unstructured data.Leverage AWS services including S3, Glue, Lambda, EMR, IAM, EventBridge, CloudWatch, Kinesis, and Redshift to support end-to-end data workflows.Optimize Spark jobs, Delta tables, and Databricks workloads for performance, scalability, and cost efficiency.Partner with Data Engineers, Architects, Analytics teams, and business stakeholders to deliver high-quality data solutions.Implement data quality controls, monitoring, alerting, and operational support processes.Troubleshoot and resolve complex production issues across Databricks and AWS environments.Contribute to engineering best practices, code reviews, automation, and platform modernization initiatives.Required Qualifications7+ years of Data Engineering experience building enterprise-scale data platforms and pipelines.5+ years of hands-on Databricks development experience in production environments.Strong expertise in Python, PySpark, and SQL with a focus on pipeline development.Extensive experience developing and supporting data pipelines within AWS.Strong knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold).Hands-on experience with AWS services such as S3, Glue, Lambda, EMR, Redshift, Kinesis, IAM, and CloudWatch.Deep understanding of Spark architecture, distributed data processing, performance tuning, partitioning, and optimization.Experience building highly scalable batch and streaming data processing solutions.Strong understanding of data modeling, data warehousing concepts, and modern data architectures.Experience supporting production environments, monitoring data pipelines, and troubleshooting complex data issues.Preferred QualificationsExperience with Databricks Workflows, Delta Live Tables (DLT), Unity Catalog, and Structured Streaming.Experience with Kafka, Airflow, or cloud-native orchestration frameworks.Experience implementing CI/CD pipelines using GitHub Actions, Jenkins, or Azure DevOps.Infrastructure as Code experience utilizing Terraform or CloudFormation.Databricks Certified Data Engineer Associate or Professional certification.Experience working within large enterprise AWS environments supporting mission-critical data platforms.Apply NowEqual Opportunity EmployerWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.Home|About|Adaptive AI|Industries|Consulting |Contact Us© 2004-2026, Machine Learning Technologies LLC, or its affiliates","company":"Machine Learning Technologies","rawCompany":"machine learning technologies","city":"Malvern","state":"PA","isRemote":false,"isActive":false,"createdAt":"2026-11-12T09:41:45.636Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Databricks Developer","description":"HomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsHomeAboutAdaptive AIIndustriesConsulting Jobs PortalContact UsJob DescriptionJob OverviewJob ID:J54834Job Title:Senior Databricks DeveloperLocation:Malvern, PADuration:12 Months + ExtensionDomain Exposure:Consumer StaplesClient:To Be Discussed LaterEmployment Type:W-2, 1099, C2CWork Authorization:US Citizen, Green Card, H-1B, OPT-EAD, CPT, OtherView All JobsSimilar JobsSenior GCP Platform Engineer - Woodland Hills, CASenior Snowflake Data Warehouse Engineer / Data Engineer - Madison, WISenior Full Stack Developer with React.js - Warren, MISalesforce Senior Business Analyst - Atlanta, GASenior SAP S/4HANA Functional Architect - Cincinnati, OHJob Title: Senior Databricks DeveloperLocation: Malvern, PADuration: 12 Months + ExtensionBill Rate: $81/hour (C2C)Job Type: W-2, 1099, C2CClient: To Be Discussed LaterWork Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, OtherJob SummaryWe are seeking a Senior Databricks Developer with 7+ years of Data Engineering experience and deep expertise in Databricks, AWS, PySpark, Python, and SQL. This is a highly technical, hands-on engineering role within a data engineering team focused primarily on building, enhancing, and supporting enterprise data pipelines. The ideal candidate will have extensive experience developing cloud-native data solutions in AWS, implementing Delta Lake and Medallion architectures, and delivering scalable, production-grade data pipelines using Databricks. This is not a consulting role; we are looking for a developer who enjoys building and optimizing data platforms and solving complex data engineering challenges.ResponsibilitiesDesign, develop, and maintain large-scale ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.Build scalable and highly reliable data ingestion, transformation, and orchestration frameworks within AWS.Develop and support Delta Lake implementations and Medallion Architecture (Bronze, Silver, Gold) data pipelines.Create and optimize batch and streaming pipelines that process large volumes of structured and unstructured data.Leverage AWS services including S3, Glue, Lambda, EMR, IAM, EventBridge, CloudWatch, Kinesis, and Redshift to support end-to-end data workflows.Optimize Spark jobs, Delta tables, and Databricks workloads for performance, scalability, and cost efficiency.Partner with Data Engineers, Architects, Analytics teams, and business stakeholders to deliver high-quality data solutions.Implement data quality controls, monitoring, alerting, and operational support processes.Troubleshoot and resolve complex production issues across Databricks and AWS environments.Contribute to engineering best practices, code reviews, automation, and platform modernization initiatives.Required Qualifications7+ years of Data Engineering experience building enterprise-scale data platforms and pipelines.5+ years of hands-on Databricks development experience in production environments.Strong expertise in Python, PySpark, and SQL with a focus on pipeline development.Extensive experience developing and supporting data pipelines within AWS.Strong knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold).Hands-on experience with AWS services such as S3, Glue, Lambda, EMR, Redshift, Kinesis, IAM, and CloudWatch.Deep understanding of Spark architecture, distributed data processing, performance tuning, partitioning, and optimization.Experience building highly scalable batch and streaming data processing solutions.Strong understanding of data modeling, data warehousing concepts, and modern data architectures.Experience supporting production environments, monitoring data pipelines, and troubleshooting complex data issues.Preferred QualificationsExperience with Databricks Workflows, Delta Live Tables (DLT), Unity Catalog, and Structured Streaming.Experience with Kafka, Airflow, or cloud-native orchestration frameworks.Experience implementing CI/CD pipelines using GitHub Actions, Jenkins, or Azure DevOps.Infrastructure as Code experience utilizing Terraform or CloudFormation.Databricks Certified Data Engineer Associate or Professional certification.Experience working within large enterprise AWS environments supporting mission-critical data platforms.Apply NowEqual Opportunity EmployerWe are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.Home|About|Adaptive AI|Industries|Consulting |Contact Us© 2004-2026, Machine Learning Technologies LLC, or its affiliates","datePosted":"2026-11-12T09:41:45.636Z","dateModified":"2026-11-12T09:41:45.636Z","hiringOrganization":{"@type":"Organization","name":"Machine Learning Technologies","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Malvern","addressRegion":"PA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"98eef0b050406375d27207b4"},"url":"https://jobsearcher.com/jobs/98eef0b050406375d27207b4"}}