Senior Data Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
A cutting-edge company focused on revolutionising healthcare through innovative data solutions is seeking a skilled Senior Data Engineer. This organisation is dedicated to building robust and secure platforms that transform complex health data into actionable insights, driving better patient outcomes.The Role Design and own end-to-end data architecture, including secure cloud object storage, validated ingestion pipelines, and a curated analytics layer. Build resilient ingestion pipelines for diverse data formats (CSV/JSON/XML/HL7/X12) with schema validation, error quarantine, and full data lineage. Establish and operate a curated data layer (data warehouse/lakehouse-lite) to support analytics and machine learning workloads without impacting transactional systems. Select, integrate, and manage essential data tools, including object storage, orchestrators (Dagster, Prefect, Airflow), and data validation frameworks. Design and enforce comprehensive data governance in a HIPAA-regulated environment, covering PHI/PII classification, encryption, access control, auditing, and de-identification. Collaborate with cross-functional teams (backend, ML, product, clinical) to define data contracts and ensure high data quality.What You'll Need BS/BA degree or higher in Computer Science, Engineering, or a related technical field. 8+ years of professional data engineering experience, with a proven track record of delivering production data systems. Mastery of PostgreSQL, including schema design, indexing, query tuning, partitioning, and operating at scale. Strong experience in designing and operating data pipelines for both file-based and API-based ingestion. Proficient with dbt (or similar SQL-based transformation frameworks) and modern data modeling patterns (Kimball, Data Vault, One Big Table). Hands-on experience with one or more cloud platforms (AWS preferred) and their data primitives (e.g., S3, managed Postgres). Expertise in data governance within HIPAA-regulated environments, including PHI/PII protection, encryption, and least privilege principles.What's On Offer Comprehensive benefits package including medical/dental/vision insurance, HSA, and 401(k). Opportunity to work with cutting-edge technologies and drive innovation in healthcare data. A collaborative and agile work environment focused on impactful solutions.Apply via Haystack today!