Software Engineer III - Analytical Data
Overview:
In this role you design and operate data pipelines and lakehouse components to surface fresh, trusted data across teams. You'll own production-grade pipelines and collaborate with data consumers, producer teams, and platform engineers to shape the data platform. You will work across streaming and batch ingestion, multi-engine access, and data observability to ensure data quality at scale. This role offers hands-on engineering ownership in a fast, collaborative environment focused on scalable data infrastructure. You'll contribute to a mission to provide a governed, single source of truth for data across the organization. Compensation / Benefitscomprehensive benefitsmind, body and lifestyle programshybrid work modelsalary range listed ($112,000—$176,000 USD)bonus/equity potential
Responsibilities:
- Build and run Kotlin and Apache Beam pipelines on Google Cloud Dataflow to load data into Apache Iceberg tables
- Maintain large Iceberg tables for performance and cost-efficiency, including partitioning and Spark maintenance jobs
- Enable queryability of datasets across BigQuery, Snowflake, and Starburst/Trino via Iceberg catalogs and stable views
- Collaborate with producer teams on schemas and data contracts and document dataset publishing
- Develop observability to ensure data freshness and completeness with Datadog dashboards and monitors
- Own production pipelines end-to-end, including incident response and fixes
- Deliver through CI/CD, testing (unit/integration/e2e), and Terraform-managed infrastructure across GCP and AWSEngage daily with data consumers, producer teams, and platform teams to influence the platform's technical roadmap
Key requirements:
- 3+ years in software engineering focused on data engineering or distributed systems
- Proficiency in Kotlin, Java, or Python (pipelines in Kotlin; table maintenance/orchestration in Python)
- Hands-on experience with Apache Beam or Apache Spark; production Kafka knowledge
- Experience designing for very large datasets and distributed systems
- Understanding of lakehouse architectures and open table formats, ideally Apache Iceberg
- Strong SQL skills and working knowledge of BigQuery, Snowflake, or Starburst/Trino
- Experience with Protobuf or Avro schemas and evolving schemas safely
- Experience with GCP or AWS (GCP-first approach with AWS catalog/storage)
- Cross-team collaboration
- Ownership mindset
- Pragmatic balance of quality and speed
- Apache BeamApache SparkKafka