AWS Databricks Engineer
Full Time or Contract w2 with shakti Solutions - No C2c / H1B transfers. Design and implement end-to-end lifecycle of Databricks platform on AWS.Design and implement different environments like Dev/SIT/UAT/PROD for Databricks. Expertise in AWSImplement data access controls, Lineage and auditing using Unity catalog. Implement CI/CD pipelines between different environments. Hands-on architecture experience within AWS, Azure, or GCP environments. Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management. Translate business requirements into technical blueprints, run proof-of-concepts (POCs), and guide engineering teams on best practicesAI/ML Enablement, experience in setting up AI and Genie for Databricks. Experience with Delta lake house, Unity catalog, DBX notebooks, Python, Pyspark, Genie, Databricks Apps