Data Platform Engineer

Experience: 3+ YearsWE Can Only do W2 here.

Role Overview: We are seeking a Data Platform Engineer to build a new data platform integrating internal systems using Medallion Architecture. The role owns end-to-end data pipelines, from ingestion through Bronze, Silver, and Gold transformations, while migrating existing Alteryx workflows to dbt and Python. The engineer will also develop an MCP server that enables AI agents to query business-specific data marts, supporting AI-driven analytics initiatives.

Key Responsibilities: Ingest data from Microsoft SQL Server and Oracle into the Bronze layer using CDC-based incremental ingestion. Develop dbt models for the Silver layer, including cleansing, standardization, deduplication, and data quality testing. Build Gold-layer business data marts and migrate existing Alteryx transformation logic. Configure Apache Iceberg tables and REST Catalog, including schema evolution and time travel. Develop and maintain Apache Airflow DAGs for scheduling, dependencies, and failure notifications. Develop an MCP server enabling AI agents to access Gold-layer data marts, metadata, ontology, and query execution. Manage metadata and data lineage using OpenMetadata. Automate Excel reporting using Python and openpyxl.

Required Qualifications: 3+ years of hands-on data engineering experience in production environments. Advanced SQL skills, including window functions, CTEs, and query tuning. Hands-on dbt experience with model design, incremental strategies, macros, and tests. Proficiency in Python and pandas for data processing and automation. Experience developing Apache Airflow DAGs. Experience with at least one analytical engine: Trino/Presto, Apache Spark, or DuckDB.Experience with at least one lakehouse format: Apache Iceberg, Delta Lake, or Apache Hudi. Knowledge of Medallion Architecture and star schema/dimensional modeling. Experience integrating relational databases such as SQL Server and Oracle using CDC or batch processing. Familiarity with Kubernetes and MinIO (S3-compatible storage).

Preferred Qualifications: Experience with Airbyte, Fivetran, or Apache Polaris. Familiarity with governance tools such as OpenMetadata or DataHub, and semantic layers such as Cube.dev. Ability to interpret Alteryx (.yxmd) workflows and migrate their logic to SQL/dbt. Experience developing MCP servers, LLM applications, RAG, or AI agent pipelines. Experience building APIs or backend services using Java and/or Python. Hands-on experience with LangChain or LangGraph for tool-enabled AI agents and multi-step workflows. Understanding of retail and home appliance business domains, including PSI (Production, Sales, and Inventory) and sales analytics.