Data Engineer
Senior Data Engineer – GCP & Cloud Spanner 6 Months Contract Hybrid Role - Frisco, TX | Atlanta, GA | Bellevue, WAVideo Interview We are looking for a Senior Data Engineer with strong hands-on experience in GCP, real-time data pipelines, Cloud Spanner.
Key Responsibilities:
Build real-time data pipelines using GCP Pub/Sub and Dataflow (Apache Beam).Design and optimize Google Cloud Spanner and BigQuery for high-volume data ingestion and low-latency data access.
Develop streaming pipelines using Kafka, Spark Structured Streaming, CDC, and PySpark.
Support Azure-to-GCP migration using Databricks, Delta Lake, Snowflake, and Azure data services.
Implement data quality, monitoring, security, and CI/CD best practices.
Required Skills:
5+ years of Data Engineering experience, including 2+ years in production real-time pipelines.
Mandatory hands-on experience with Google Cloud Spanner, including schema design, indexing, and data ingestion.
Strong experience with GCP Pub/Sub, Dataflow (Apache Beam), and BigQuery.
Expertise in SQL, Python, PySpark, Kafka/Spark Streaming, CDC, and SCD Type 2.Experience with Databricks, Delta Lake, Snowflake, and Azure data services.
Knowledge of Terraform, CI/CD, and Airflow/Cloud Composer.