Databricks Devops Engineer
Databricks DevOps Engineer – Azure | Terraform | CI/CD📍 Location: Dallas, TX💼 Experience: 6–12 years🏢 Employment Type: Full-TimeJob Overview We are looking for an experienced Databricks DevOps Engineer with strong expertise in Azure, Databricks, CI/CD, Terraform, API development, and DevOps automation. The ideal candidate will have hands-on experience building and integrating APIs, developing Terraform modules, and implementing automated CI/CD pipelines.
Must-Have:
- Skills 7+ years of experience in API development and 3rd-party API integrations
- Strong SQL skills – SQL Server or OracleStrong scripting experience with Python, Bash, and/or PowerShellExperience with Git, GitHub, and/or GitLabStrong understanding of CI/CD pipelines and DevOps best practices
- Hands-on experience with Azure Databricks
- Strong experience with Terraform and Terraform module development
- Experience with Jenkins and GitLab CI/CDExperience with Azure services and security
- Experience with:
- Azure AD / Microsoft Entra IDOAuthJWTAzure AD B2CApp Registrations
- Azure App InsightsAKSSignalRMicrosoft Teams SDKTeams application development
- Azure Bots / Bot Framework
- Preferred / Nice-to-HaveData Engineering experience
- Strong understanding of ETL/ELTData modeling
- Data warehousing
- Big data concepts
- Workflow automation experience
Key Responsibilities:
Design, develop, and maintain APIs and integrations with third-party applications.
Develop and maintain CI/CD pipelines using Jenkins and GitLab CI/CD.Build and maintain reusable Terraform modules and infrastructure automation.
Support and manage Azure Databricks environments.
Implement DevOps automation and deployment best practices.
Work with Azure authentication and authorization technologies including Azure AD, OAuth, JWT, and Azure AD B2C.Support Azure services including AKS, App Insights, SignalR, and App Registrations.
Collaborate with data engineering teams on ETL/ELT and Databricks-related initiatives.
Troubleshoot technical issues and provide effective solutions across development and deployment environments.
Ideal Candidate:
The ideal candidate combines DevOps + Azure + Databricks + Terraform expertise with strong API development and scripting skills. Excellent analytical, troubleshooting, communication, and problem-solving skills are required.