Senior Data Platform Engineer

Job ID: J53632Job Title:

Location: Sunnyvale, CA

Duration: 10 Months + Extension

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, L2-EAD, GC-EAD

Client: To Be Discussed Later

Employment Type: W-2, 1099, C2CView All Jobs

Job Description: Design, deploy, and operate data platform services on Kubernetes in Microsoft Azure. Build and manage lakehouse infrastructure on Apache Iceberg backed by ADLS, including catalog configuration, table maintenance, schema evolution, and partitioning strategy. Operate and tune Trino and Spark clusters for performance, reliability, and cost efficiency. Develop and maintain data transformation pipelines using DBT, with sound modeling, testing, and documentation practices. Define and enforce standards for data access, security, governance, and multi-tenant resource management across ADLS and query engines. Implement observability for the platform, including monitoring, alerting, capacity planning, and incident response. Partner with data engineers, analysts, and platform teams to onboard workloads and resolve performance bottlenecks. Automate infrastructure and deployments using infrastructure-as-code and CI/CD.

Required Qualifications: Strong hands-on experience with Kubernetes, including deploying and operating stateful and distributed workloads. Strong hands-on experience with Microsoft Azure Cloud, including ADLSHands-on experience with Apache Iceberg and Iceberg catalogs RESTExpertise in distributed query and compute technologies, specifically Trino and Spark.Hands-on experience with DBT for data transformation and analytics engineering. Solid understanding of data lake and lakehouse architectures, file formats (Parquet, ORC), and query optimization. Apply NowEqual Opportunity Employer We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law. Home|About|Adaptive AI|Industries|Consulting |Contact Us© 2008-2018, Machine Learning Technologies LLC. All Rights Reserved.