Lead Data Engineer (Databricks)

Dice is the leading career destination for tech experts at every stage of their careers. Our client, Acunor Infotech, is seeking the following. Apply via Dice today!Location: Los Angeles, CA (Hybrid 3 Days Onsite)Type: Full-TimeExperience: 9 14 YearsJob SummaryWe are seeking a Lead Data Engineer with strong expertise in Databricks, PySpark, and scalable data engineering to support large-scale media and streaming data environments. The role involves building high-performance ETL/ELT pipelines, optimizing data infrastructure, and supporting analytics and reporting initiatives.Must-Have Skills9+ years of experience in Data EngineeringStrong hands-on experience with DatabricksExpertise in SQL, Python, and PySparkStrong experience in ETL / ELT pipeline developmentExperience with Data Modeling & Data WarehousingExperience building Lakehouse architecturesHands-on experience with Airflow or workflow orchestration toolsStrong understanding of performance optimization and monitoringExperience with AWS cloud platformsExcellent communication and stakeholder management skillsKey ResponsibilitiesDesign, build, and maintain scalable ETL/ELT pipelinesDevelop and optimize data models, lakehouse, and warehouse solutionsBuild high-volume batch and near real-time data pipelinesMonitor, troubleshoot, and optimize production workloadsImplement orchestration and workflow automation solutionsCollaborate with analytics, reporting, and engineering teamsLead technical discussions and mentor engineering teamsSupport scalable solutions for streaming and subscription datasetsNice to HaveExperience in Media / Streaming / Subscription platformsExperience handling high-volume consumer datasetsExposure to real-time data processing environments