Databricks Solution Architect
About the Role:We are seeking an experienced Resident Solution Architect with deep expertise in Databricks, Data Engineering, and Cloud Platforms to lead enterprise-scale data modernization initiatives. The ideal candidate will combine strong technical leadership with hands-on implementation experience, helping customers design, build, optimize, and scale modern data platforms on Databricks.This is a customer-facing role requiring excellent consulting, architecture, and delivery skills.Preferred Certifications:Databricks Data Engineer Professional (Required)Key Responsibilities:Design and architect scalable data platforms using Databricks.Lead end-to-end implementation of enterprise data engineering solutions.Provide technical leadership and architectural guidance to customer teams.Build and optimize batch and streaming data pipelines using Apache Spark.Design high-performance, scalable, and cost-efficient data architectures.Collaborate with engineering teams to implement CI/CD pipelines and DevOps best practices.Drive performance tuning, troubleshooting, and optimization across Databricks workloads.Work closely with stakeholders to translate business requirements into technical solutions.Mentor engineering teams and promote Databricks best practices.Stay current with new Databricks platform capabilities and recommend adoption where appropriate.Support MLOps workflows and data platform operational excellence.Required Qualifications:7+ years of experience in Data Engineering, Data Platforms, and Analytics.10+ years of overall consulting or professional services experience.Databricks Data Engineer Professional Certification (required).Successfully delivered 6–8+ Databricks implementation projects with significant hands-on development experience.Strong expertise in Apache Spark and distributed computing with a solid understanding of Spark runtime internals.Experience with modern cloud platforms including AWS, Azure, and GCP, with deep expertise in at least one.Strong understanding of CI/CD pipelines and production deployment practices.Working knowledge of MLOps concepts and deployment workflows.Strong knowledge of the Databricks Lakehouse Platform and current product capabilities.Experience optimizing performance, scalability, and cost for enterprise data workloads.Excellent communication, consulting, and stakeholder management skills.Preferred Skills:Delta LakeUnity CatalogDelta Live Tables (DLT)Databricks WorkflowsStructured StreamingSQLPythonPySparkData ModelingData GovernanceInfrastructure as Code (Terraform preferred)Git, Azure DevOps, GitHub Actions, or JenkinsRequired Technical Skills:DatabricksApache SparkPySparkPythonSQLDelta LakeAWS / Azure / GCPCI/CDMLOpsPerformance TuningDistributed SystemsData EngineeringPlease send your updated resume to:📧 swapnil_v@bayrecruit.com