{"schemaVersion":"jobsearcher.job.v1","id":"c7d249dda78e8cc5badb281d","url":"https://jobsearcher.com/jobs/c7d249dda78e8cc5badb281d","canonicalUrl":"https://jobsearcher.com/jobs/c7d249dda78e8cc5badb281d","title":"Databricks Platform Administration","description":"Role : Databricks Platform AdministrationLocation : Warren, NJ (Hybrid)Databricks Platform AdministrationDay-to-day Databricks operations are supported by a dedicated administration team. This role establishes the platform standards and reference configurations that team works from, and serves as a senior technical partner on architecture, design decisions, and complex escalations. That partnership requires genuine administrative depth across the following areas.• Account & Workspace Administration: Account console configuration, workspace provisioning and topology decisions, workspace-level settings, admin role delegation, and multi-workspace strategy.• Unity Catalog: Metastore design and regional strategy, catalog/schema/table permission models, storage credentials and external locations, Hive metastore migration, lineage and audit, and Delta Sharing configuration.• Identity & Access: Entra ID integration, SCIM provisioning, identity federation, groups and entitlements, service principals, and token policy.• Compute Governance: Cluster policies, instance pools, node type and runtime standards, autoscaling and autotermination enforcement, Photon and serverless evaluation, and SQL warehouse sizing and configuration.• Cost & Usage Analysis: System tables, usage attribution, and DBU forecasting — with the ability to assess a workspace, identify where spend is concentrated, and recommend a remediation path.• Technical Partnership: Review platform configurations, contribute to design decisions, and support the administration and data teams on issues that span infrastructure and Databricks. Publish the standards, reference configurations, and self-service patterns that allow those teams to move quickly and safely.• Cross-Boundary Diagnostics: Investigate job failures, cluster startup issues, permission errors, connectivity faults, and performance concerns, and determine whether the root cause sits in infrastructure, Databricks configuration, or the workload itself.Role ScopeTo set clear expectations about how this position divides from adjacent teams:• Production ETL/ELT pipeline development and Spark transformation work sit with the data engineering team.• Model development, training, and tuning sit with the data science team.• Dimensional modeling, dbt development, and BI/semantic layer work sit outside this role.• Day-to-day Databricks administration is handled by a dedicated team; this role provides the standards, architecture, and senior technical partnership behind it.Required Qualifications• Experience: 6+ years in cloud infrastructure or platform engineering, with at least 4 years focused on Microsoft Azure.• Terraform: Expert-level, hands-on. You have authored and maintained production Terraform modules, managed remote state, and run infrastructure as code through CI/CD. This is a core daily skill in this role.• Databricks Administration: Demonstrable hands-on administration experience — account and workspace administration, Unity Catalog, cluster policies, identity federation, and cost governance. You should be able to describe administrative decisions you have made and explain the tradeoffs behind them.• Technical Partnership: A track record as a senior technical resource to adjacent teams, including guiding stakeholders from an initial request to the underlying requirement and building consensus around the recommended approach.• Azure Networking & Security: Deep working knowledge of private endpoints, VNets and hub-spoke design, NSGs, Entra ID, managed identities, RBAC, and Key Vault.• Data Lake Architecture: ADLS Gen2 design and access control at enterprise scale.• Azure Data Factory: Platform-side experience with integration runtimes, managed VNet, credential management, and deployment automation.• Automation & Scripting: Strong Python, plus PowerShell and/or Bash, for platform tooling and automation.• Spark & SQL Literacy: Sufficient working knowledge to diagnose infrastructure and configuration-level performance issues and engage credibly with data teams. Spark development depth is not a requirement for this role.","company":"eSolutions","rawCompany":"esolutions","city":"Hackettstown","state":"NJ","isRemote":false,"isActive":false,"createdAt":"2026-09-02T08:18:43.862Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1244.00","title":"Network and Computer Systems Administrators","slug":"network-and-computer-systems-administrators"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Databricks Platform Administration","description":"Role : Databricks Platform AdministrationLocation : Warren, NJ (Hybrid)Databricks Platform AdministrationDay-to-day Databricks operations are supported by a dedicated administration team. This role establishes the platform standards and reference configurations that team works from, and serves as a senior technical partner on architecture, design decisions, and complex escalations. That partnership requires genuine administrative depth across the following areas.• Account & Workspace Administration: Account console configuration, workspace provisioning and topology decisions, workspace-level settings, admin role delegation, and multi-workspace strategy.• Unity Catalog: Metastore design and regional strategy, catalog/schema/table permission models, storage credentials and external locations, Hive metastore migration, lineage and audit, and Delta Sharing configuration.• Identity & Access: Entra ID integration, SCIM provisioning, identity federation, groups and entitlements, service principals, and token policy.• Compute Governance: Cluster policies, instance pools, node type and runtime standards, autoscaling and autotermination enforcement, Photon and serverless evaluation, and SQL warehouse sizing and configuration.• Cost & Usage Analysis: System tables, usage attribution, and DBU forecasting — with the ability to assess a workspace, identify where spend is concentrated, and recommend a remediation path.• Technical Partnership: Review platform configurations, contribute to design decisions, and support the administration and data teams on issues that span infrastructure and Databricks. Publish the standards, reference configurations, and self-service patterns that allow those teams to move quickly and safely.• Cross-Boundary Diagnostics: Investigate job failures, cluster startup issues, permission errors, connectivity faults, and performance concerns, and determine whether the root cause sits in infrastructure, Databricks configuration, or the workload itself.Role ScopeTo set clear expectations about how this position divides from adjacent teams:• Production ETL/ELT pipeline development and Spark transformation work sit with the data engineering team.• Model development, training, and tuning sit with the data science team.• Dimensional modeling, dbt development, and BI/semantic layer work sit outside this role.• Day-to-day Databricks administration is handled by a dedicated team; this role provides the standards, architecture, and senior technical partnership behind it.Required Qualifications• Experience: 6+ years in cloud infrastructure or platform engineering, with at least 4 years focused on Microsoft Azure.• Terraform: Expert-level, hands-on. You have authored and maintained production Terraform modules, managed remote state, and run infrastructure as code through CI/CD. This is a core daily skill in this role.• Databricks Administration: Demonstrable hands-on administration experience — account and workspace administration, Unity Catalog, cluster policies, identity federation, and cost governance. You should be able to describe administrative decisions you have made and explain the tradeoffs behind them.• Technical Partnership: A track record as a senior technical resource to adjacent teams, including guiding stakeholders from an initial request to the underlying requirement and building consensus around the recommended approach.• Azure Networking & Security: Deep working knowledge of private endpoints, VNets and hub-spoke design, NSGs, Entra ID, managed identities, RBAC, and Key Vault.• Data Lake Architecture: ADLS Gen2 design and access control at enterprise scale.• Azure Data Factory: Platform-side experience with integration runtimes, managed VNet, credential management, and deployment automation.• Automation & Scripting: Strong Python, plus PowerShell and/or Bash, for platform tooling and automation.• Spark & SQL Literacy: Sufficient working knowledge to diagnose infrastructure and configuration-level performance issues and engage credibly with data teams. Spark development depth is not a requirement for this role.","datePosted":"2026-09-02T08:18:43.862Z","dateModified":"2026-09-02T08:18:43.862Z","hiringOrganization":{"@type":"Organization","name":"eSolutions","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Hackettstown","addressRegion":"NJ","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"c7d249dda78e8cc5badb281d"},"url":"https://jobsearcher.com/jobs/c7d249dda78e8cc5badb281d"}}