JOBSEARCHER

Developer - AWS, Python

Long term contract position with a financial firm. Hybrid 3 days/week in Newark, NJ. 1. Design and development of batch and real-time data pipelines using AWS Data & Analytics Services such as AWS Glue, Athena, Lambda, Redshift etc.,2. Experience in building complex data processing and ETL jobs using Pyspark and SQL3. Experience in ingesting and processing structured and semi-structured data4. Exposure to data warehousing, data lake and lake house architectures5. Good understanding of different data modeling techniques6. Ability to optimize cost and improve performance of data pipelines7. Exposure to CI/CD process8. Knowledge of best practices in securing data pipelines and data assets in AWS.9. Knowledge of data quality and data governance processes is a plus.payrate - 65 - 80 per hour depending on experience.