{"schemaVersion":"jobsearcher.job.v1","id":"a69c8f1cfa7abbe303443d86","url":"https://jobsearcher.com/jobs/a69c8f1cfa7abbe303443d86","canonicalUrl":"https://jobsearcher.com/jobs/a69c8f1cfa7abbe303443d86","title":"Data Engineer with Databricks","description":"Position: Data Engineer with DatabricksLocation: Wilmington, DEKey Skills: Databricks | PySpark | Python | SQL | ETL/ELT | Delta Lake | Spark | Cloud | Data EngineeringResponsibilitiesDesign and develop scalable ETL/ELT data pipelines using Databricks.Develop data-processing and transformation solutions using PySpark and Python.Write complex SQL queries for data transformation, validation, and analysis.Build and maintain solutions using Delta Lake and Lakehouse architecture.Integrate data from multiple sources, including databases, APIs, files, and cloud storage.Optimize Spark jobs, Databricks workloads, and SQL queries for performance and cost efficiency.Implement data-quality, validation, reconciliation, monitoring, and error-handling mechanisms.Troubleshoot production data issues and perform root-cause analysis.Collaborate with business analysts, architects, and application teams to translate business requirements into technical solutions.Follow engineering best practices for testing, source control, CI/CD, documentation, and production deployment. Required Skills & Experience5–8 years of overall Data Engineering experience.Strong hands-on experience with Databricks.Strong hands-on development experience using PySpark / Apache Spark.Strong Python programming skills and advanced SQL skills.Experience developing production-grade ETL/ELT pipelines.Experience with Delta Lake and Lakehouse concepts.Experience processing large-volume and complex datasets.Good understanding of data modeling, data quality, and data governance principles.Strong troubleshooting and performance-tuning skills.Experience with at least one cloud platform: Microsoft Azure, AWS, or Google Cloud.Experience with Git and CI/CD practices.Good to Have SkillsDatabricks Unity Catalog experience.Databricks Workflows / Jobs and cluster optimization experience.Experience with Azure Data Factory or Apache Airflow.Experience with Kafka or Spark Structured Streaming.Knowledge of cloud-native storage and data services.Databricks or cloud certification.Experience in banking or financial-services data environments.Work AuthorizationApplicants must be legally authorized to work in the United States.Equal Employment OpportunityThemesoft Inc is an Equal Employment Opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other status protected by applicable federal, state, or local law.RegardsPatrick FernandezTalent Acquisition Group - Strategic Recruitment Manager","company":"ThemeSoft","rawCompany":"themesoft","city":"Wilmington","state":"DE","isRemote":false,"isActive":false,"createdAt":"2026-10-21T10:10:39.159Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer with Databricks","description":"Position: Data Engineer with DatabricksLocation: Wilmington, DEKey Skills: Databricks | PySpark | Python | SQL | ETL/ELT | Delta Lake | Spark | Cloud | Data EngineeringResponsibilitiesDesign and develop scalable ETL/ELT data pipelines using Databricks.Develop data-processing and transformation solutions using PySpark and Python.Write complex SQL queries for data transformation, validation, and analysis.Build and maintain solutions using Delta Lake and Lakehouse architecture.Integrate data from multiple sources, including databases, APIs, files, and cloud storage.Optimize Spark jobs, Databricks workloads, and SQL queries for performance and cost efficiency.Implement data-quality, validation, reconciliation, monitoring, and error-handling mechanisms.Troubleshoot production data issues and perform root-cause analysis.Collaborate with business analysts, architects, and application teams to translate business requirements into technical solutions.Follow engineering best practices for testing, source control, CI/CD, documentation, and production deployment. Required Skills & Experience5–8 years of overall Data Engineering experience.Strong hands-on experience with Databricks.Strong hands-on development experience using PySpark / Apache Spark.Strong Python programming skills and advanced SQL skills.Experience developing production-grade ETL/ELT pipelines.Experience with Delta Lake and Lakehouse concepts.Experience processing large-volume and complex datasets.Good understanding of data modeling, data quality, and data governance principles.Strong troubleshooting and performance-tuning skills.Experience with at least one cloud platform: Microsoft Azure, AWS, or Google Cloud.Experience with Git and CI/CD practices.Good to Have SkillsDatabricks Unity Catalog experience.Databricks Workflows / Jobs and cluster optimization experience.Experience with Azure Data Factory or Apache Airflow.Experience with Kafka or Spark Structured Streaming.Knowledge of cloud-native storage and data services.Databricks or cloud certification.Experience in banking or financial-services data environments.Work AuthorizationApplicants must be legally authorized to work in the United States.Equal Employment OpportunityThemesoft Inc is an Equal Employment Opportunity employer. We consider qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other status protected by applicable federal, state, or local law.RegardsPatrick FernandezTalent Acquisition Group - Strategic Recruitment Manager","datePosted":"2026-10-21T10:10:39.159Z","dateModified":"2026-10-21T10:10:39.159Z","hiringOrganization":{"@type":"Organization","name":"ThemeSoft","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Wilmington","addressRegion":"DE","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"a69c8f1cfa7abbe303443d86"},"url":"https://jobsearcher.com/jobs/a69c8f1cfa7abbe303443d86"}}