Lead Databricks Platform Engineer

Lead Databricks AdministratorA subsidiary of Publicis Groupe, Epsilon powers data-driven marketing at massive scale for some of the world's leading brands. We're hiring a Lead Databricks Administrator to own and evolve our Databricks platform across cloud environments. This is a high-impact role focused on driving platform standards, strengthening governance, and improving reliability across enterprise data systems. You'll support large-scale Data Lake environments across AWS, Azure, and GCP, helping enable critical data operations for key clients.Responsibilities What You'll Achieve:Lead and scale Databricks platform administration across enterprise workspaces and multi-cloud environments (AWS, Azure, GCP)Establish and enforce standards for workspace provisioning, access controls, compute configuration, and governance to improve platform consistency and stabilityDrive operational excellence by implementing repeatable processes, automation, and best practices across Databricks environmentsStrengthen platform reliability, performance, and cost efficiency through proactive monitoring, optimization, and issue resolutionPartner cross-functionally with Engineering, Security, Cloud, and Operations teams to ensure secure, compliant, and scalable platform architectureOwn and improve identity and access management practices (least privilege, group management, service principals, admin controls)Lead troubleshooting and resolution of complex issues across Databricks, cloud infrastructure, networking, and data workloadsEvaluate and adopt new Databricks capabilities to enhance governance, scalability, and operational efficiencyBuild and maintain documentation, runbooks, and platform standards to support long-term maintainability and audit readinessMentor team members and promote best practices to elevate overall platform maturitySupport production operations, incident response, and ongoing platform health in a high-impact, enterprise environmentQualifications What You'll Bring with You:BS in Computer Science or related technical discipline, or equivalent practical experience7+ years of experience in data platform, database administration, or cloud infrastructure roles3+ years of hands-on experience administering Databricks (workspaces, clusters, jobs, SQL Warehouses, platform services)Strong expertise in: Databricks workspace and account management Platform governance, access controls, and administration best practices Compute configuration, cluster policies, and workload optimization Experience supporting Databricks across AWS, Azure, or GCP environments Hands-on experience with infrastructure provisioning and automation (Terraform, APIs, scripting, CI/CD pipelines) Strong understanding of identity and access management: SSO, SCIM provisioning, RBAC Service principals, group management, least privilege models Working knowledge of Unity Catalog, data governance frameworks, and secure data access patterns Experience implementing and maintaining platform standards (naming conventions, provisioning workflows, configuration baselines, access controls) Proven ability to monitor, troubleshoot, and optimize platform performance, reliability, and cost efficiency Experience diagnosing issues across Databricks, cloud infrastructure, networking, identity, and data pipelines Strong SQL, Unix/Linux, and scripting skills; Python or Scala is a plus Experience building and maintaining documentation, runbooks, and operational processes to support audit readiness and platform scalability Familiarity with incident response, change management, and production support in enterprise environments Ability to operate independently, manage multiple priorities, and contribute to a high-ownership, cross-functional environment Strong communication skills with the ability to work effectively across engineering, security, and platform teamsBecause You Matter As an Epsilon employee, you deserve perks and benefits that put you, your family and your finances first. Our benefits encompass a wide range of offerings, including but not limited to: Time to recharge: Flexible time off (FTO), 14 paid holidays, paid sick time Family well-being: Parental/new child leave, childcare & elder care assistance, adoption assistance Extra perks: Comprehensive health coverage, 401(k), tuition assistance, commuter benefits, professional development, employee recognition, charitable donation matching, health coaching and counseling Epsilon benefits are subject to eligibility requirements and other terms.Epsilon is an Equal Opportunity Employer. Epsilon's policy is not to discriminate against any applicant or employee based on actual or perceived race, age, sex or gender (including pregnancy), marital status, national origin, ancestry, citizenship status, mental or physical disability, religion, creed, color, sexual orientation, gender identity or expression (including transgender status), veteran status, genetic information or any other characteristic protected by applicable federal, state or local law.Epsilon also prohibits harassment of applicants and employees based on any of these protected categories. Epsilon will provide accommodations to applicants who need accommodations to complete the application process. Please reach out to LeaveofAbsence@epsilon.com to request an accommodation.CompensationRange: USD $98,000.00 - USD $182,000.00/Annually. This is the pay range the Company believes it will pay for this position at the time of this posting. Consistent with applicable law, compensation will be determined based on the skills, qualifications, and experience of the applicant along with the requirements of the position, and the Company reserves the right to modify this pay range at any time.