Lead Databricks Data Engineer
Position: Senior / Lead Databricks Data Engineer
Location: Charlotte, NC
Work Arrangement: (Hybrid - 3 days onsite)
Type of Hire : Contract
Job Description:
We are looking for a Senior/Lead Databricks Data Engineer to support a strategic data engineering initiative. The ideal candidate should have strong hands-on experience with Databricks, PySpark, Python, and SQL.
Key Responsibilities:
Design and develop scalable data pipelines using Databricks and PySpark.
Develop ETL/ELT pipelines using Python and SQL.Work with Delta Lake and Lakehouse architecture.
Optimize Spark/Databricks jobs for performance and scalability.
Work with cloud data platforms such as Azure/AWS.Develop and maintain Databricks workflows and data pipelines.
Collaborate with architects, developers, and business teams.
Troubleshoot and resolve data engineering issues.
Required Skills:
12+ years of experience in Data Engineering.
Strong hands-on experience with Databricks.
Strong PySpark/Spark, Python, and SQL skills.
Experience with Delta Lake/Lakehouse.
Experience with Azure Databricks or other cloud platforms.
Strong understanding of data pipelines and ETL/ELT.Excellent communication and problem-solving skills.
Experience leading technical initiatives, mentoring engineers, and working with stakeholders.