Data Engineer
Role: Data Engineer and GCP data Engineer
Location: Phoenix AZ (local candidate)
Duration: Long Term Contract
Strong understanding of ETL and ELT patterns, data integration, data modeling, and distributed data processing. Hands-on development experience with Apache Spark using Scala and/or Python/PySpark. Experience working with RDBMS technologies and modern lakehouse/table formats, preferably Apache Iceberg. Experience with distributed SQL/query technologies such as Starburst and Trino. Experience designing real-time and streaming data solutions using technologies such as Apache Kafka and Spark Streaming. Understanding of integration patterns across NiFi, Kafka, Spark, RDBMS, and lakehouse platforms for batch and real-time data processing. Strong knowledge of software engineering practices including CI/CD, automated testing, source control, infrastructure/platform automation, observability, and production support. Experience with data governance, metadata management, data lineage, data quality, and secure data access in enterprise environments.