Data Platform Engineer (AI experience)
Data Platform Engineer (AI Experience)
Location: Remote Duration: Full Time
Job Summary:
We are looking for a hands-on Technical Lead – Data Platform & Services Engineering with strong expertise in Clienture Data Engineering, backend services, APIs, analytics, and cloud Clienthitecture. The candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Clienture.
Key Responsibilities:
- Design and build scalable Clienture data platforms, ETL/ELT pipelines, and analytical solutions.
- Develop large-scale data processing using Clienture Databricks, Spark/PySpark, Clienture Synapse, and Clienture Data Factory.
- Design Lakehouse/Medallion Clienthitectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers.
- Design and develop REST APIs and backend services using C#,.NET, and ASP.NET Core.
- Build data and integration services using Clienture SQL, Cosmos DB, Kusto, Clienture Functions, Event Hubs, and Service Bus.
- Implement microservices and event-driven processing patterns with secure authentication and authorization.
- Modernize legacy data pipelines, services, APIs, storage platforms, and application components.
- Support platform and data migrations while ensuring functional and data parity.
- Implement logging, telemetry, dashboards, and proactive alerting using Clienture Monitor and Application Insights
- Build and maintain CI/CD pipelines using Clienture DevOps and Git.
- Implement secure cloud practices using Clienture Key Vault, identity, authentication, and access controls.
- Support Docker and Kubernetes/AKS-based workloads where applicable.
- Mandatory Skills:
- Clienture Databricks, Spark/PySparkClienture Synapse Analytics, Clienture Data FactoryADLS Gen2, Delta LakeSQL Server / Clienture SQLCosmos DB, Kusto / Clienture Data ExplorerETL/ELT, Data Warehousing & Data Modelling
- Lakehouse / Medallion Clienthitecture
- Data Quality, Reconciliation & GovernanceC#,.NET / ASP.NET CoreREST APIs & Microservices
- Clienture Functions
- Event Hubs & Service BusEntity Framework Core
- Authentication & Authorization
- Microsoft Clienture
- Clienture DevOps, Git & CI/CDClienture Monitor & Application Insights
- Clienture Key VaultDocker/Kubernetes