Databricks Support Engineer

About role - We are seeking a Databricks Support Engineer with strong experience in production support and data platform operations. The ideal candidate will be responsible for monitoring, troubleshooting, and maintaining Databricks-based data pipelines and ensuring high availability of data platforms. This role requires hands-on expertise in handling P1/P2 incidents, supporting critical data workloads, and working closely with data engineering and DevOps teams in a fast-paced environment. Key ResponsibilitiesProvide production support for Databricks-based data pipelines and workflowsMonitor jobs, clusters, and data pipelines to ensure smooth operationsHandle P1/P2 incidents, perform troubleshooting, and ensure timely resolutionPerform root cause analysis (RCA) and implement preventive measuresSupport batch and streaming data pipelines built using Databricks (PySpark/SQL)Manage and optimize Databricks clusters for performance and costWork closely with Data Engineering, DevOps, and Business teams during issue resolutionEnsure adherence to SLAs and maintain system uptimeMaintain logs, documentation, and incident reportsParticipate in on-call rotation and weekend (Saturday) support Required SkillsStrong hands-on experience with DatabricksExperience in production support / incident management (P1/P2)Good knowledge of PySpark and SQLExperience with Delta Lake, data pipelines, and ETL workflowsFamiliarity with job scheduling tools (Databricks Workflows, Airflow, Control-M, etc.)Strong troubleshooting and debugging skillsUnderstanding of monitoring and alerting tools