JOBSEARCHER

Senior Databricks Developer – AWS

Senior Databricks Developer – AWS *Location:* Wilmington, DE / Columbus, OH *Job Type:* Long-Term Contract *Work Mode:* Onsite – 5 Days a Week *Experience:* 10 Years
Job Description: We are seeking an experienced *Senior Databricks Developer* with strong hands-on expertise in Databricks, AWS, PySpark, and modern data engineering technologies. The ideal candidate will have proven experience developing, optimizing, and supporting enterprise-scale data pipelines in production environments. *Important:* We are looking for genuine, hands-on Databricks Developers. Generic Data Engineer resumes without strong Databricks development experience will not be considered.
Key Responsibilities:
  • Design, develop, and maintain scalable data pipelines using Databricks, PySpark, and Spark SQL.
  • Build and optimize data processing solutions on AWS.
  • Implement Delta Lake and Lakehouse architecture for enterprise data platforms.
  • Develop and maintain Lakeflow pipelines, Delta Live Tables (DLT), and streaming workflows.
  • Perform Spark performance tuning, troubleshooting, and cost optimization.
  • Work with large-scale datasets and distributed processing frameworks.
  • Implement data quality checks, monitoring, and production support processes.
  • Support CI/CD pipelines and automated deployment of data engineering solutions.
  • Collaborate with cross-functional teams to deliver reliable and scalable data platforms.
Required Skills:
  • Strong hands-on experience with Databricks development.
  • Expertise in AWS data services, including S3, Glue, Lambda, and related services.
  • Advanced knowledge of PySpark, Spark SQL, and Apache Spark.
  • Strong experience with Delta Lake and Lakehouse architecture.
  • Experience developing production-grade data pipelines.
  • Knowledge of Lakeflow, Delta Live Tables (DLT), and streaming data pipelines.
  • Strong debugging, performance tuning, and problem-solving skills.
Preferred Qualifications:
  • Experience with Scala and advanced Spark optimization.
  • Knowledge of Databricks MLOps and model deployment workflows.
  • Understanding of Data Mesh architecture and data governance.
  • Experience with Lakebase.
  • Financial services or banking domain experience is a plus.
Important Candidate Requirements
  • Must be available to work onsite five days a week in Wilmington, DE or Columbus, OH.
  • Strong hands-on Databricks development experience is mandatory.
  • Generic Data Engineer profiles without substantial Databricks development experience will not be considered.
  • Pure administration or architecture-only profiles are not suitable for this position.
  • Candidates should have experience building and supporting production data pipelines.
How to Apply: Interested candidates can send their updated resumes to:
*Email:* nikhil.k@sgnglobaltech.com Please include your current location, work authorization status, and availability when applying. Only relevant profiles with strong hands-on Databricks and AWS experience will be considered.
Pay: $65.00 - $75.00 per hour
Work Location: In person