Senior Databricks Platform & Application Engineer
Role : Senior Databricks Platform & Application EngineerLocation : USA(Remote)CONTRACT NOTE: 40% Databricks platform, 25% DevOps security, 20% Python application, and 15% data/database. Mandatory Experience10+ years of overall experience in Data Engineering/Application Engineering.3+ years of hands-on Databricks experience.Proven experience taking Databricks-hosted applications from development to production.Strong experience in production support, troubleshooting, and operational management.Experience implementing CI/CD and security best practices for Databricks environments.JOB DESCRIPTION:Design, develop, and deploy applications on the Databricks platform.Manage and optimize Databricks Workspaces, SQL Warehouses, and Delta Lake architecture.Implement and maintain Unity Catalog for governance and access management.Support production Databricks applications and troubleshoot platform-related issues.Monitor platform performance, reliability, and scalability.Implement CI/CD pipelines for Databricks applications and data workflows.Configure IAM roles, service principals, secrets management, and access controls.Ensure compliance with security and governance standards.Automate deployment and operational processes.Develop and maintain Python-based applications hosted on Databricks.Build APIs, automation scripts, and backend services.Implement application monitoring, logging, and troubleshooting.Support production incidents and performance optimization.Design and optimize PostgreSQL databases.Write complex SQL queries and develop reporting solutions.Manage Delta Lake tables and data pipelines.Ensure data quality, integrity, and performance