GCP Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
GCP Data Engineer Paramus, NJOnly FTE or Contract to hire Detailed JD: Designs, builds, and optimizes secure, scalable, and high-performance data pipelines and analytics solutions using Google Cloud Platform tools like BigQuery, Dataflow, Dataproc, Composer, GCS, Cloud function, Cloud run and Pub/Sub. This role requires 5+ years of experience, expertise in Python/SQL, and implementing data governance and CI/CD pipelines.
Key Responsibilities:
Pipeline Development: Design, build, and optimize end-to-end data pipelines using GCP-native services (Dataflow, Dataproc, Cloud Storage) and Python.
Data Modeling & Architecture: Create high-quality, reproducible data models in BigQuery using partitioning, clustering, and materialized views to enhance performance and manage costs.
Streaming & Real-time: Implement real-time streaming pipelines using Pub/Sub and Apache Beam/Spark Streaming.
Infrastructure & DevOps: Establish CI/CD pipelines for data workflows.
Security & Governance: Implement best practices for data security, including IAM roles, encryption (CMEK), and VPC Service Controls.
Collaboration: Work with stakeholders to define requirements, mentor junior engineers, and produce technical documentation. Required Technical Skills
Languages:
Strong SQL and Python proficiency. Platforms: Deep expertise in Google Cloud Platform (GCP).
Tools:
BigQuery, Dataflow, Cloud Composer (Airflow), Pub/Sub, Cloud Storage, Dataproc, Cloud sql, Cloud run, Cloud function, logging and monitoring Data Modeling: Database design, ETL/ELT workflows.
Qualifications
Experience: 5+ years in GCP data engineering
Must have delivered at least 2 to 3 end to end projects as a data engineer using GCP Services Strong SQL and Python proficiency. Strong understanding of database design, data modeling (relational, dimensional, NoSQL).Expertise in data integration, ETL/ELT, and data pipeline development. Knowledge of cloud security best practices, identity management, and networking. Familiarity with DevOps, CI/CD, and containerization (Docker, Kubernetes).Excellent communication and problem-solving skills.
Education: Bachelor’s degree in computer science, Engineering, or relevant field.
Certifications: Google Cloud Professional Data Engineer certification is highly preferred
Email: himanshuk@arkhyatech.com