AWS Data Engineer

W2 opportunity, No H1B' work visa candidatesKey Responsibilities:Design, develop, and maintain scalable data pipelines using AWS services such as Glue, Redshift, S3, Lambda, and Athena.Implement data integration solutions for ingesting, processing, and storing large volumes of structured and unstructured data.Collaborate with data scientists and analysts to design and optimize ETL processes.Ensure the security, integrity, and availability of data across different AWS environments.Optimize and monitor data pipelines for performance and cost efficiency.Automate data workflows using AWS Step Functions, Lambda, and other relevant tools.Develop and maintain comprehensive documentation of data pipelines and architecture.Troubleshoot and resolve any issues related to data infrastructure or data quality.Participate in code reviews and provide feedback to ensure best practices are followed.Stay current with emerging trends and technologies in data engineering and cloud computing.Required Skills & Qualifications:Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent experience).10+ years of experience in data engineering with a focus on AWS.Strong proficiency with AWS services such as Glue, Redshift, S3, Lambda, and Athena.Experience with data modeling, ETL/ELT processes, and data warehousing.Proficient in SQL, Python, and/or Scala.Strong understanding of data security best practices, particularly in cloud environments.Experience with CI/CD pipelines and version control systems, preferably Git.Excellent problem-solving skills and attention to detail.Strong communication and collaboration skills, with the ability to work effectively in a team environment.