JOBSEARCHER

AWS Data Engineer with Python - Remote

AWS Data Engineer With PythonYour future duties and responsibilities: Design the architecture for migrating on-premise data warehouse and data marts to the data lake and subsequent vending on AWS Cloud. Architect solutions for the design and implementation of Big & Fast Data Infrastructure on AWS cloud using Kafka, Glue, Athena, Redshift, DynamoDB.Guide other teams to design, develop, and deploy data sets and tools that support product use cases. Very strong Python development experience where the candidate has worked on several features that is pushed to production (more than 5 years).Spark knowledge and PySpark development experience (hands-on coding) which include deploying to EMR or Glue around 3+ years. Working experience with Lambda, Step functions, SQS & SNS (minimum 2 year).Hands on development experience using IDE (PyCharm, IntelliJ, Eclipse etc) 5+ years. Good knowledge of ETL process. Should have deployed his project to PROD and preferably done some PROD support. Required qualifications to be successful in this role:12+ years of relevant experience. Must have AWS data AND application experience. Should be strong in: AWS serverless services (Lambda, Step function, batch)AWS Big data service (EMR, ECS)AWS Storage services (S3)AWS Database services (Glue catalog, Redshift)AWS deployment service (CodeCommit, Code pipeline, CLoudformation) PyMust have 5+ Python Development exprinceSQLTesting and debugging experience on AWSLinux and shell script Database systems (SQL and NoSQL) Data warehousing solutionsETL tools Data APIs. Understanding the basics of distributed systems. Knowledge of algorithms and data structures. Have worked in Lead position Excellent communication Desired Skillset: AWS Solutions Architect, AWS Developer certificationsEDUCATIONAL REQUIREMENTS:Bachelor's degree in computer science, Information Systems or related field
Skills:
  • ETL - 8 year(s)
  • Linux - 8 year(s)
  • Shell Script