Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Position: Data Engineer
Location: Chicago, IL (3 days office)
Employment: Contract
Job Description:
Data Engineer with expertise in ETL development, Python, SQL, and cloud-based data processing, responsible for building and managing scalable data pipelines using Databricks, AWS, and modern DevOps practices.
Responsibilities:
- -Perform Develop and manage ETL processes using Python, PySpark, and SQL.Work with Databricks for data processing.
- Utilize AWS services like S3, CloudWatch, IAM, SNS, and Lambda.
- Familiarity with Terraform for infrastructure management.
- Work with Angular for front-end integration.
- Collaborate on version control using Git and deployment using Octopus and Azure DevOps.
- Support CI/CD processes using Git, Octopus, and Azure DevOps.
- Work within cloud-based data engineering environments and data processing frameworks.
- Mandatory skills
- Strong ETLPythonSQLPySparkAngular for front-end development
- Experience with AWS services (S3, CloudWatch, IAM, SNS, Lambda)
- Terraform knowledge
- Experience with Git, Octopus, and Azure DevOps for CI/CD