Databricks Engineer
About Our Client:
Vidha IT Solutions LLC is a technology services company providing IT and data solutions across various industries. The organization focuses on addressing complex challenges through modern technology and supports a collaborative and growth-oriented work environment.
About the Opportunity:
The DATABRICKS ENGINEER role is focused on designing, developing, and maintaining scalable data pipelines using Databricks and Apache Spark. This position is responsible for optimizing ETL/ELT workflows, collaborating with data scientists and business stakeholders, and managing Databricks resources to ensure performance and cost efficiency. The role contributes by enabling reliable and high-quality data delivery to support data-driven decision-making.
Responsibilities:
- Design, develop, and maintain scalable data pipelines using Databricks and Apache SparkBuild and optimize ETL/ELT workflows for data ingestion, transformation, and delivery
- Collaborate with data scientists, analysts, and business stakeholders
- Manage and monitor Databricks clusters, notebooks, and job scheduling for performance and cost efficiency
- Implement Delta Lake architecture and data governance best practices
- Integrate Databricks with cloud platforms such as AWS, Azure, or GCP and enterprise data sources
- Troubleshoot and resolve data pipeline issues to ensure high availability and data quality
Requirements:
- Proven experience as a Databricks Engineer or Data Engineer with practical Databricks expertise
- Strong proficiency in Apache Spark, PySpark, and SQLExperience with Delta Lake, Lakehouse architecture, and data modeling
- Familiarity with cloud platforms (AWS, Azure, or GCP) and cloud-native data services
- Experience building and managing ETL/ELT pipelines at scale
- Knowledge of Python, Scala, or other relevant programming languages
- Strong problem-solving skills and ability to work collaboratively in a fast-paced environment
- Pay Range and Compensation Package:
The pay range and compensation package for this role will be determined based on the candidate's experience, skills, and other relevant factors.
Equal Opportunity Statement: Our client is an equal opportunity employer. They celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, or national origin.
Note:
RemoteHunter is a recruitment partner of this role. Please note that all employment decisions, including candidate assessment, interviews, hiring, compensation, and employment terms, are made exclusively by the hiring employer.