Senior DevOps Engineer – Azure, Terraform & Databricks

Role : Senior DevOps Engineer – Azure, Terraform & DatabricksMust : Onsite for F2F client interview required : Only local candidate (Alpharetta, Georgia)Must have skills : Data Brick/Kafka Location: Alpharetta GAKey Responsibilities:Design, implement, and manage Azure cloud infrastructure for scalable and reliable applications.Develop and maintain Terraform scripts for automated infrastructure provisioning and configuration.Build and manage big data clusters, including Azure Databricks and On-Premise Hadoop, for advanced analytics and data processing workloads.Set up and maintain CI/CD pipelines using GitLab CI and Harness, ensuring robust and automated deployment processes.Integrate connectivity between Gitlab CI, Nexus Repository and Harness CD to allow seamless delivery.Collaborate with cross-functional teams to improve infrastructure performance, security, and scalability.Monitor infrastructure and applications for performance issues, troubleshooting, and resolving incidents.Participate in on-call rotations to address critical issues and ensure system reliability. Key Skills and Experience:Cloud Expertise: Proficiency in Azure cloud services, including virtual networks, storage accounts, WebApp services, Spring Apps, Databricks and Kubernetes (AKS).Infrastructure as Code: Deep knowledge of Terraform for IaC implementation and best practices.Big Data Technologies: Hands-on experience with Databricks and On-Premise Hadoop for big data workloads.CI/CD Tools: Advanced experience with GitLab CI for continuous integration and Harness for deployment automation.Artifact Management: Familiarity with Nexus Repository for managing build artifacts.Scripting and Automation: Proficiency in Python, Bash, or PowerShell for automation tasks.Version Control: Expertise in Git workflows and best practices.