Senior Azure Databricks Platform Engineer

Job Title: Senior Azure Databricks Platform EngineerLocation: Dallas, TX 75202Work Arrangement: Hybrid RoleJob Type: 12 months ContractInterview: Three rounds of Video interviewJob Description:Prepare the Databricks Serverless environment for the teamSet up job clustersEnsure all libraries needed are presentWork with Databricks and CDO to ensure all AI capabilities are enabledMigrate existing Databricks jobs and workflowsResolve Azure networking, proxy, firewall, and authentication issues in Databricks and web applicationsOptimize performance, cost, and scalability of Databricks workloadsEnhance monitoring, alerting, and job reliability improvements by creating a UI that tracks all jobs start, completion, duration and statusMaintain and enhance DataSphere health check frameworkSupport Unity Catalog, access controls, and environment governanceTroubleshoot production issues and failed jobsCreate Genie Spaces for each Domain as the jobs are migratedStrong Databricks experience, including workflows, jobs, clusters, serverless, and performance optimizationAzure cloud experience, including networking, proxy, firewall, authentication, and application deploymentsPython, SQL, ETL development, and migration experience with Databricks and SnowflakeProduction data pipeline support, monitoring, alerting, and job reliabilityUnity Catalog, access controls, governance, and data quality frameworksAt least one contractor must have React, TypeScript/JavaScript, API integration, and custom Azure web app development experiencePreferred: Databricks AI capabilities, AI/LLM applications, health check automation, dashboards, SSO/OAuth/Entra ID, and operational UI development