Data Platform Engineer
ARCHIVED
We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.
Job Description: ComResource is looking for a Data Platform Engineer.
Responsibilities:
- Design and implement Dataiku Project Standards to act as a production readiness linter, ensuring all projects meet naming, metadata, and security requirements.
- Develop custom Dataiku plugins and API integrations to automate Tier 1 and Tier 2 data quality checks, blocking promotion to production if standards are not met.
- Partner with Information Security to integrate tokenization and field-level encryption directly into Dataiku visual recipes and Python code-based workflows.
- Build and maintain the promotion path where ad-hoc Dataiku prototypes are hardened and, where necessary, refactored into DBT for long-term enterprise use.
- Integrate Dataiku monitoring with Service
- Now to automate incident creation for pipeline failures or data quality drift.
- Serve as the technical steward for non-technical business units, providing approved templates and secure data products.
Essentials:
Hands-on experience with Dataiku DSS.Proficiency in Python and SQL.Experience working in Linux/Unix environments.
Experience building governance-as-code layers and automated data quality frameworks.
Ability to bridge the gap between rapid prototyping and production-grade engineering.
Desired:
Experience with Snowflake, Terraform, GitHub, and REST APIs.
Req ID: AM127734720