Data Engineer

We are working with a global leader in IT staffing and services, providing technology expertise and solutions to thousands of clients worldwide, including a significant portion of the Fortune 500.The Role Design, develop, and deploy data pipelines across Hadoop and Google Cloud Platform environments Build and support Spark-based processing pipelines using PySpark and Python Develop and maintain real-time streaming pipelines with Kafka, Spark Streaming, and Flink Migrate data and workloads from on-prem Hadoop to Google Cloud Platform Work extensively with BigQuery, Cloud Composer, Data Proc, and Cloud Storage Conduct integration testing, production deployments, and pipeline optimizationWhat You'll Need 3+ years of experience in Data Engineering, including Hadoop and Google Cloud Data Solutions Experience with Google Cloud Platform Data Services: BigQuery, Cloud Storage, Data Proc, Cloud Composer 2+ years of real-time processing experience with Kafka, Flink, and Spark Streaming 3+ years of data lake experience with Python and PySpark Ability to independently convert requirements into scalable technical designs Experience with enterprise change-management and access-management proceduresWhat's On Offer Opportunity to work on a large-scale data migration to Google Cloud Platform Collaborative team setting focused on modernization Competitive hourly compensation Comprehensive benefits package including medical, dental, vision, 401(k), and time offApply via Haystack today!