JOBSEARCHER

Data Engineer

Job Description
About the Role: We are seeking an experienced Senior Data Engineer with deep expertise in Databricks to design, develop, and optimize enterprise-scale data pipelines. You'll play a key role in building scalable Lakehouse solutions while ensuring reliable, high-quality data for analytics, reporting, and downstream applications.
Key Responsibilities:
  • Design and build scalable ETL/ELT pipelines using Databricks
  • Develop PySpark and Spark SQL transformations
  • Build Bronze, Silver, and Gold data layers using Medallion Architecture
  • Implement Delta Live Tables, Workflows, and Unity Catalog
  • Optimize Spark jobs for scalability and performance
  • Design dimensional data models for analytical workloads
  • Implement data quality validations and monitoring
  • Collaborate with analytics, engineering, and architecture teams
  • Build reusable frameworks and automation
  • Support CI/CD deployment pipelines and Git-based development
  • Required Qualifications7–10+ years of Data Engineering experience
  • Extensive hands-on Databricks experienceStrong PySpark programming
  • Advanced Spark SQL skills
  • Experience with Delta Lake
  • Experience implementing Medallion Architecture
  • Hands-on Delta Live TablesUnity Catalog experienceStrong SQL optimization and performance tuning
  • Experience with AWS, Azure, or GCPCI/CD and Git experienceStrong understanding of distributed data systems
  • Experience designing enterprise data models
Preferred Qualifications:
  • Databricks certification
  • Experience with streaming data
  • Experience building reusable data frameworks
  • Experience with enterprise governance
  • Exposure to AI-assisted development tools including Databricks AI Genie#LI-WJ1#PSI2