Data Engineer
Job Description: Data Engineers design and build data systems and pipelines. Responsibilities include developing data processing workflows, optimizing data storage, and ensuring data accuracy. You will collaborate with data scientists and analysts to meet data requirements and resolve data issues. Strong experience in data engineering and problem-solving skills are required.
Responsibilities: a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f5; }
Required Skills Databricks
Databricks Workspace
Databricks Jobs & Workflows
Delta Lake
Delta Live Tables (DLT)
Unity Catalog
Databricks SQL
MLflow (preferred)
Programming
PySpark
Python
SQL
Spark SQL
Data Engineering
ETL / ELT Design
Data Warehousing
Data Lakes
Batch Processing
Real-Time Streaming
Data Modeling
Cloud Platforms (Any One)
Microsoft Azure
Amazon Web Services (AWS)
Google Cloud Platform (GCP)
Tools
Git
Azure DevOps / Jenkins / GitHub Actions
Airflow (preferred)
Kafka/Event Hub (preferred)
Qualifications: Bachelor's/Master's in Engineering 2-5 years