Cloud Data platform Engineer- Databricks

Design and implement end-to-end lifecycle of Databricks platform on AWS.Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.Expertise in AWSImplement data access controls, Lineage and auditing using Unity catalog.Implement CI/CD pipelines between different environments.Hands-on architecture experience within AWS, Azure, or GCP environments.Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management.Translate business requirements into technical blueprints, run proof-of-concepts (POCs), and guide engineering teams on best practicesAI/ML Enablement, experience in setting up AI and Genie for Databricks.Experience with Delta lake house, Unity catalog, DBX notebooks, Python, Pyspark, Genie, Databricks Apps.Thanks & Regards,Manikandan BShakti Group IncEmail: mbalaji@shaktisolutions.com