Data engineer with Devops
Job ID: 20142829Reference Number: 23-01140Title: Data engineer with DevopsLocation: Iselin, NJ, 08830Posted Date: 2023-07-12Contact: Shyam MaramContact Email: shyam@hanstaffing.comContact Phone: (848) 234-8733Company: HAN Staffing Cloud Engineer and DevopsPA Malvern - Hybrid MustH1b Must skills : Spark, Pyspark, Aws services (s3, lambda , dynamodb, cloudformation, Glue ETL ,Step Functions) and DeploymentResponsibilitiesBuild python application or processes on Aws cloud environment.Maintain third party solutions to help with data privacy initiativesTranslates technical specifications into code for complex new or enhancement projects for internal clients.Writes programs, develops code, tests artifacts, and produces reports. Employs software development techniques to ensure tests are implemented in a way that support automation.Participates in design, code, and test inspections throughout the life cycle to identify issues.Explains technical considerations at related meetings, including those with internal clients. Performs systems analysis activities.QualificationsLooking for candidates with 5 – 8 years of development experience in AWS and Data Engineering experienceAws services (s3, lambda , dynamodb, cloudformation, Glue ETL ,Step Functions)Strong hands on development experience in Python (including unit testing and library/utility building)Strong understanding on Spark / pysparkExperience with scala is highly desirableExperience in maintaining third party solutions on AWS is a plusExperience in Data Privacy and Governance is a plus