Senior Data Platform Engineer
Senior Data Platform Engineer
Remote: United StatesLong Term
Required Skills:
Own Production Platform: Run a near real-time streaming data platform, owning latency/throughput SLOs and on-call incident response.
Build Streaming Pipelines: Extend pipelines ingesting CDC events from operational databases and SaaS sources.
Transform with Flink: Use Java and Flink SQL to perform cross-stream joins and enrich data into canonical entities.
Ensure PHI Governance: Implement classification, row/column controls, and access policies (e.g., ABAC) for sensitive data.
Provision as Code: Define AWS infrastructure (MSK, Glue, S3) using CDK with CI/CD for all data pipelines.
Partner Across Teams: Collaborate with upstream producers and downstream consumers on data contracts and access needs.
Required Experience:
6+ years operating production data systems, with deep expertise in Apache Kafka and Kafka Connect.
Required Experience:
Production experience with a stateful stream processor in Java (Apache Flink strongly preferred).
Required Experience:
Expert-level SQL and Python, plus an AI-forward engineering mindset using agentic dev tools.
Preferred Experience: Health insurance domain knowledge, including HIPAA and governing access to PHI.