Sr. Databricks Developer
Senior Databricks Developer
Location: Columbus, OH(Locals Only)
Work Authorization: US Citizens (USC) / Green Card (GC) only
Interview: Face-to-Face (F2F) required
Job Summary:
We are looking for an experienced Senior Databricks Developer with strong expertise in Databricks, AWS, Spark, and modern data engineering architectures. The ideal candidate will have hands-on experience building scalable, high-volume ETL/ELT pipelines, implementing streaming solutions, optimizing data platforms, and supporting production-grade workloads.
Key Responsibilities:
Design, develop, and maintain scalable data engineering solutions using Databricks and AWS.Build and optimize high-volume ETL/ELT pipelines using PySpark and/or Scala Spark.
Implement Delta Lake solutions and Lakehouse architecture.
Develop and maintain streaming pipelines and Delta Live Tables (DLT) workflows.
Implement MLOps solutions and workflows within the Databricks ecosystem.
Apply Data Mesh architecture principles to distributed data platforms.
Perform advanced performance tuning and cost optimization across Databricks and AWS environments.
Monitor production workloads, troubleshoot pipeline failures, and ensure data quality and reliability.
Follow data engineering best practices for scalability, security, governance, and maintainability.
Required Skills:
10+ years of overall experience in data engineering or related technologies.
Deep hands-on knowledge of Databricks and AWS ecosystems.
Strong expertise in Delta Lake and Lakehouse architecture.
Proficiency in PySpark and/or Scala Spark.
Experience developing high-volume, production-grade ETL/ELT pipelines.
Hands-on experience with streaming and Delta Live Tables (DLT).Experience with MLOps on Databricks.
Knowledge of Data Mesh architecture.
Strong performance tuning and cost optimization skills.
Excellent troubleshooting and problem-solving abilities.