Senior AWS Data Engineer – Python, AWS Glue & DynamoDB

Visa: US CitizenGreen CardGC-EADH4-EADTNEAD

Job Summary: We are seeking a hands-on AWS Data Engineer with strong expertise in Python, PySpark, AWS Glue, and DynamoDB to design, develop, and maintain production-grade data pipelines. The ideal candidate will have experience building scalable ETL solutions, optimizing data processing and storage, integrating APIs, and leveraging AWS services to deliver reliable and efficient data engineering solutions.

Key Responsibilities: Design, develop, and maintain scalable production data pipelines and ETL workflows using Python, PySpark, and AWS Glue. Develop and manage AWS Glue jobs, crawlers, triggers, and workflows for data ingestion, transformation, and processing. Design and optimize DynamoDB data models, capacity planning, streams, and performance. Build and manage data solutions using AWS services, including S3, Lambda, Step Functions, CloudWatch, IAM, KMS, and Kinesis. Develop, test, and troubleshoot API integrations using Postman. Write and optimize SQL queries and implement data transformation processes aligned with data warehousing principles. Implement version control, CI/CD pipelines, and infrastructure automation using Git, CloudFormation, or Terraform. Monitor data pipeline performance, troubleshoot failures, and implement improvements for reliability, scalability, and cost efficiency. Apply appropriate security, access control, and data protection practices across AWS data solutions. Explore and leverage AI tools to improve development productivity, automation, and data engineering workflows.

Required Qualifications: Hands-on data engineering experience with a proven track record of building and supporting production data pipelines. Expert-level proficiency in Python for data processing, ETL development, and automation, including PySpark. Deep experience with AWS Glue, including job development, crawlers, triggers, and workflow orchestration. Strong expertise in DynamoDB data modeling, capacity planning, streams, and performance optimization. Solid understanding of AWS services, including S3, Lambda, Step Functions, CloudWatch, IAM, KMS, and Kinesis. Proficiency with Postman for API development, testing, and collaboration. Strong SQL skills and understanding of data warehousing concepts. Experience with Git, CI/CD tools, and Infrastructure as Code (IaC) using CloudFormation or Terraform. Knowledge of AI tools and their application in development or automation workflows. Strong analytical, troubleshooting, and problem-solving skills. Refer