AWS Data Engineer

NoteOnly W2.Only USC,GC.Title: AWS Data EngineerLocation: Onsite in Torrance, CADuration: 6-12+ months contractJob DescriptionDaily Tasks Performed:Develop And Maintain Data Integration SolutionsDesign and implement data integration workflows using AWS Glue/EMR Lambda RedshiftDemonstrate proficiency in Pyspark Apache Spark and Python for data processing large datasetsEnsure data is accurately and efficiently extracted transformed and loaded into target systems.Ensure Data Quality And IntegrityValidate and cleanse data to maintain high data quality.Ensure data quality and integrity by implementing monitoring validation and error handling mechanisms within data pipelinesOptimize Data Integration ProcessesEnhance the performance optimization of data workflows to meet SLAs scalability of data integration processes and cost-efficiency on AWS cloud infrastructure.Identify and resolve performance bottlenecks fine-tuning queries and optimizing data processing to enhance Redshift's performanceRegularly review and refine integration processes to improve efficiency.Support Business Intelligence And AnalyticsTranslate business requirements to technical specifications and coded data pipelinesEnsure timely availability of integrated data for business intelligence and analytics.Collaborate with data analysts and business stakeholders to meet their data requirements.Maintain Documentation And ComplianceDocument all data integration processes workflows and technical system specifications.Ensure compliance with data governance policies industry standards and regulatory requirements.What Will This Person Be Working OnThe IT Data Integration Engineer / Developer is tasked with the design development and management of data integration processes to ensure seamless data flow and accessibility across the organization. This role is pivotal in integrating data from diverse sources transforming it to meet business requirements and loading it into target systems such as data warehouses or data lakes. The aim is to support the organization's data-driven decision-making by providing high-quality consistent and accessible data.Position Success Criteria Desired - 'WANTS'Bachelor's degree in computer science information technology or a related field. A master's degree can be advantageous.7-10 years of experience in data engineering database design ETL processes5 in programming languages such as PySpark Python5 years of experience with AWS tools and technologies S3 EMR Glue Athena RedShift Postgres RDS Lambda PySpark3 years of experience of working with databases/ data marts/data warehousesProven experience in ETL development system integration and CI/CD implementation.Experience in complex database objects to move the changed data across multiple environmentsSolid understanding of data security privacy and compliance.Excellent problem-solving and communication skills.Display good communication skills to effectively collaborate with multi-functional teamsParticipate in agile development processes including sprint planning stand-ups and retrospectivesProvide technical guidance and mentorship to junior developersAttention to detail and a commitment to data quality.Continuous learning mindset to keep up with evolving technologies and best practices in data engineering.