Sr. AWS Data Engineer

FOR IMMEDIATE DETAILS about this position, please feel free to contact EITHER of US and REFERENCE the JOB#: MICHELL CASEY: (949) 860-4715 or MCasey@calance.com TRENT CASEY: (949) 558-4246 or TCasey@calance.com ======================================================= • • We will NOT accept 3rd Party (C2C) Contractors * • ======================================================= JOB DETAILS: Position: Sr. AWS Data Engineer Job Ref #: 44990 - JIH5JP00004614 Duration: 12+ Months (On-going Contract) Location: HYBRID - Torrance, CA 90501 Pay Rate: $77.75 per hour (W2 ONLY) HIRING REQUIREMENTS: • • NOT accepting any 3rd Party C2C candidates for any reason • • • • NOT accepting candidates who are on work visa's, such as EAD or H1B • • • • NOT accepting candidates who live more than 45 miles from Torrance • • NOT accepting candidates willing to relocate (LOCAL CANDIDATES Only) • • HYBRID SCHEDULE: MON-FRI (must work ONSITE MON-THUR) Develop and Maintain Data Integration Solutions: • Design and implement data integration workflows using AWS Glue/EMR, AWS MWAA (Airflow), Lambda, and Redshift • Demonstrate proficiency in PySpark, Apache Spark and Python for data processing large datasets • Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems. Ensure Data Quality and Integrity: • Validate and cleanse data to maintain high data quality. • Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines Optimize Data Integration Processes: • Enhance the performance, optimization of data workflows to meet SLAs, scalability of data integration processes and cost-efficiency on AWS cloud infrastructure. • Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift performance • Regularly review and refine integration processes to improve efficiency. Support Business Intelligence and Analytics: • Translate business requirements to technical specifications and coded data pipelines • Ensure timely availability of integrated data for business intelligence and analytics. • Collaborate with data analysts and business stakeholders to meet their data requirements. • Maintain Documentation and Compliance: • Document all data integration processes, workflows, and technical & system specifications. • Ensure compliance with data governance policies, industry standards, and regulatory requirements. REQUIRED EXPERIENCE: • 5+ years of experience in data engineering, database design, ETL processes, and data warehousing. • 3+ years of experience with AWS tools and technologies, such as S3, EMR, Glue, Athena, Redshift, RDS, Spectrum and Airflow • 2+ years of experience with CI/CD tools. • Strong knowledge of data storage and processing technologies, including databases and data lakes based distributed computing frameworks (e.g., Hadoop, Spark). • 3+ years programming in Python, Java, or Scala. • Must have experience designing and developing Data Pipelines and Support them. • Primary Skills : AWS EMR , GLUE, AIRFLOW, ICEBERG, REDSHIFT, RDS , IDMC, AMAZON KIRO and CI/CD DESIRED SKILLS: • Informatica Cloud tool experience (IDMC) • Agentic AI experience with Amazon Kiro ========================================== ========================================== Calance Consultant Benefits Offerings: • EPO/PPO Medical Plans • HMO/PPO Dental programs • Vision - VSP (Vision Plan Summary) • 401K Retirement vesting program (VOYA) • Paid Bi-Weekly/Direct Deposit • Flex Spending Plan • Voluntary Life, AD&D, STD or LTD plans