Databricks with AWS Infrastructure
Job Title: Databricks with AWS Infrastructure Location: Malvern, PA (ONSITE)
Contract Required Skills:
5+ years of Data Engineering experience.
Strong expertise in Databricks, PySpark, Spark, Python, and SQL.Hands-on experience with AWS services such as S3, Glue, EMR, Lambda, Redshift, and IAM.Experience building ETL/ELT pipelines and Data Lake/Lakehouse solutions.
Knowledge of Delta Lake, CI/CD, Git, and Infrastructure as Code (Terraform/CloudFormation).
Responsibilities:
Develop and optimize data pipelines using Databricks and AWS.Design scalable data lake and analytics solutions.
Monitor, troubleshoot, and improve data platform performance.
Collaborate with cross-functional teams to deliver data-driven solutions.