Databricks Engineer
Overview:
As a Databricks Engineer you will design and implement scalable data pipelines using Python and Java, with Databricks notebooks and REST APIs at the core. You will partner with data architects to deliver lakehouse solutions and ensure high data quality and performance across platforms. This role focuses on building reliable ETL/ELT workflows, optimizing processing, and enabling data access through robust APIs. A strong hands-on background and collaboration with cross-functional teams will drive transformation. Compensation / Benefitspaid vacationpaid sick leavepaid holidays 401(k) with employer matchingmedical, dental, and vision insurancelife and disability insurance
Responsibilities:
- Develop reusable, efficient code for large-scale data processing
- Design and maintain scalable data processing solutions using Python and JavaBuild and optimize data ingestion, transformation, and orchestration pipelines
- Ensure data quality, reliability, and performance across data platforms
- Develop and maintain Databricks notebooks and workflows
- Design, implement, and optimize ETL/ELT pipelines in Databricks
- Monitor pipeline health, troubleshoot failures, and improve processing efficiency
- Collaborate with data architects to implement lakehouse solutions
- Design and develop RESTful APIs for data access and integration
Key requirements:
- 8-10 years of experience
- Bachelor's Degree in Computer Science or equivalent experience
- Databricks, Python, Java, ETL, REST, Test Data Management, data analytics
- DatabricksPythonJavaETL/ELTREST APIsdata ingestion