AWS Cloud engineer with knowledge of Spark / Python

Role: AWS Cloud Engineer with Knowledge of Spark/PythonLocation: Plano, TX / Wilmington, DE Type: Contract / Full time Key Responsibilities:Cloud Architecture & Infrastructure:Design, implement, and manage scalable and reliable cloud infrastructure on AWS.Utilize AWS services such as EC2, S3, Lambda, EMR, RDS, and Redshift to build and maintain data processing pipelines.Implement security best practices and ensure compliance with industry standards.Big Data Processing:Develop and optimize big data processing workflows using Apache Spark.Write efficient Spark jobs in Python to process large datasets.Implement ETL (Extract, Transform, Load) processes to move and transform data across different systems.Automation & Scripting:Automate deployment, scaling, and management of applications on AWS using Python and AWS CloudFormation or Terraform.Create and manage CI/CD pipelines to ensure smooth deployment of code into production.Performance Optimization:Monitor and optimize the performance of cloud infrastructure and data processing jobs.Identify and address bottlenecks in the system to improve processing times and resource utilization.Collaboration & Documentation:Work closely with data engineers, data scientists, and other stakeholders to gather requirements and deliver cloud-based solutions.Document architecture, processes, and configurations for future reference and maintenance.Required Skills:AWS Cloud Services: Proficiency in AWS services such as EC2, S3, Lambda, EMR, RDS, Redshift, and CloudFormation.Programming: Strong programming skills in Python, with experience in writing and optimizing code for data processing.Big Data Technologies: Hands-on experience with Apache Spark for big data processing.Scripting & Automation: Experience in automation using Python, Shell scripting, and infrastructure as code tools like Terraform or CloudFormation.Security: Knowledge of AWS security best practices, including IAM roles, security groups, and encryption.Problem-Solving: Strong analytical skills to troubleshoot and resolve technical issues in a cloud environment.Preferred Qualifications:Experience: 5+ years of experience in cloud engineering, big data processing, and Python development.Certifications: AWS Certified Solutions Architect, AWS Certified Big Data - Specialty, or similar certifications.DevOps Tools: Familiarity with DevOps tools like Jenkins, Docker, and Kubernetes.Agile Methodology: Experience working in Agile/Scrum environments.Education:Bachelor’s degree in Computer Science, Engineering, or a related field.