Data Engineer
Data Engineer We are seeking a Data Engineer to design, build, and optimize scalable cloud-based data pipelines and infrastructure. This role will focus on developing production-ready data solutions using AWS, Databricks, PySpark, SQL, and Python to support analytics, reporting, and business intelligence.
Key Responsibilities:
Design, develop, and maintain scalable cloud-based data pipelines using AWS, Databricks, PySpark, Python, and SQL.Build and optimize ETL/ELT processes, data models, and data warehousing solutions.
Optimize Spark and SQL workloads for performance, reliability, and cost efficiency.
Monitor, troubleshoot, and support production data pipelines.
Implement CI/CD, automated deployments, unit testing, and code quality standards.
Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
Document technical designs, data flows, and processes.
Required Qualifications:
Bachelor's or Master's degree in Computer Science, Statistics, Analytics, or related field.3-5+ years of hands-on Data Engineering experience.
Strong experience with AWS, Databricks, PySpark, Python, and SQL.Experience building and supporting production data pipelines.
Strong understanding of ETL/ELT, data modeling, and data warehousing.
Experience with SQL query optimization, Spark performance tuning, and CI/CD.Strong troubleshooting, problem-solving, and communication skills.
Preferred Qualifications:
Experience with Kafka, Kinesis, AWS Glue, or AWS Lambda.
Familiarity with MongoDB and Terraform.
Experience with Power BI or Tableau.