Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Senior AWS Data Engineer
Location: Remote
Employment Type: Full-Time / Contract
Start Date: ASAPJob Description
We are looking for a Senior AWS Data Engineer with strong experience designing, developing, and supporting scalable cloud-based data solutions. The ideal candidate must have hands-on experience with AWS data services and either Databricks or Snowflake.
Responsibilities:
- Design and develop scalable ETL/ELT data pipelines using AWS services.
- Build and maintain data lakes and lakehouse solutions using Amazon S3.Develop data-processing workflows using AWS Glue, Python, PySpark, and SQL.Work extensively with either Databricks or Snowflake for data transformation, storage, and analytics.
- Integrate data from databases, APIs, files, streaming systems, and third-party platforms.
- Design efficient data models and optimize pipelines for performance, scalability, reliability, and cost.
- Implement data-quality checks, error handling, monitoring, logging, and alerting.
- Develop workflow orchestration using Apache Airflow, AWS Step Functions, or similar tools.
- Work with services such as Amazon Redshift, Lambda, EMR, Kinesis, and Athena as required.
- Implement CI/CD processes using GitHub Actions, Jenkins, AWS Code
- Pipeline, or similar tools.
- Apply security, governance, encryption, and access-control standards using AWS IAM and related services.
- Collaborate with architects, analysts, data scientists, and business stakeholders to deliver reliable data solutions.
Required Qualifications:
5+ years of experience in data engineering.3+ years of hands-on experience building data solutions on AWS.Strong experience with AWS Glue, Amazon S3, Lambda, and other AWS data services.
Strong hands-on experience with either Databricks or Snowflake.
Proficiency in Python, PySpark, and SQL.Experience developing scalable ETL/ELT pipelines and data-integration solutions.
Strong understanding of data lakes, data warehouses, lakehouse architecture, and medallion architecture.
Experience integrating structured, semi-structured, and unstructured data.
Knowledge of data modeling, performance optimization, data quality, and production monitoring.
Experience working with REST APIs and data formats such as JSON, XML, CSV, and Parquet.
Strong communication and problem-solving skills.
Preferred Qualifications:
Experience with Amazon Redshift, EMR, Athena, Kinesis, or MSK.Experience with Apache Airflow or AWS Step Functions. Knowledge of Terraform or AWS Cloud Formation. Experience with CI/CD and automated deployment processes. Familiarity with AWS security, governance, and cost-optimization practices. AWS, Databricks, or Snowflake certification is a plus.