Remote GCP Data Engineer
GCP Data Engineer Insight Global is seeking a GCP Data Engineer to support a large healthcare client. This individual will join the Network and Providers team, supporting a critical roster migration initiative involving the movement and transformation of data within Google Cloud Platform (GCP).This role requires a hands-on engineer with strong experience across Python development, GCP data engineering, PySpark, ETL, APIs, and DevOps, along with exposure to modern AI/LLM technologies. The engineer will work with large datasets in BigQuery, develop and orchestrate ETL pipelines, build cloud-native Python applications and APIs, and support CI/CD and infrastructure automation.
Day-to-Day Responsibilities:
- Design, develop, and maintain cloud-native data pipelines in GCPMove, process, and transform data within the GCP environment
- Develop ETL processes using PySpark, BigQuery, Dataproc, Dataflow, and Cloud Composer/Airflow
- Create and manage BigQuery tables and data workflows
- Build Python applications and services using Django, Flask, and/or FastAPIDevelop and maintain REST APIs and microservices
- Support solutions leveraging AI/LLMs, RAG, LangChain, and OpenAI integrations
- Deploy and support workloads using Cloud Run, GKE, and Kubernetes
- Develop and support Cloud Functions
- Write efficient SQL and PySpark for large-scale data processing
- Support CI/CD pipelines and DevOps best practices
- Assist with infrastructure automation using Terraform
- Partner with engineering and business teams to support the roster migration and broader provider/network data initiatives