{"schemaVersion":"jobsearcher.job.v1","id":"f4e4c99cc0158e786782e3bd","url":"https://jobsearcher.com/jobs/f4e4c99cc0158e786782e3bd","canonicalUrl":"https://jobsearcher.com/jobs/f4e4c99cc0158e786782e3bd","title":"Senior Databricks Platform Engineer","description":"Everforth ECS is seeking a Senior Databricks Platform Engineer to work in our Arlington, VA office (Hybrid).\n\nWe are seeking a highly skilled Senior Databricks Platform Engineer to design, implement, and maintain our enterprise-level Databricks platform supporting a federal customer organization's unified data initiative. This role's primary focus is platform management—centered on building scalable infrastructure, governance frameworks, and operational excellence—with secondary responsibilities in data engineering to support platform optimization and best practices.\n\nYou will serve as the steward of our Databricks platform, acting as the frontline technical owner responsible for creating robust, scalable processes and frameworks that enable multiple data teams to work efficiently and securely. This position offers a unique opportunity to work with cutting-edge cloud data technologies and shape the foundational infrastructure of our federal customer's data ecosystem.\n\nResponsibilities:\n\nMaintain enterprise-scale Databricks platform, managing multiple workspaces.\nBuild and maintain platform observability through development of KPIs, executive dashboards, and monitoring solutions that provide visibility into system performance, resource consumption, cost trends, and compliance adherence.\nDevelop and implement scalable user provisioning and de-provisioning processes.\nDesign and manage RBAC (Role-Based Access Control) frameworks and security groups.\nIntegrate with enterprise identity management systems (SAML, SCIM, Active Directory).\nManage Unity Catalog implementation and governance structures.\nOversee metastore configuration, catalog hierarchies, and data organization.\nImplement data lineage, auditing, and compliance frameworks.\nDesign and enforce compute policies, cluster configurations, and pool management strategies.\nImplement cost optimization frameworks and resource allocation policies.\nMonitor and optimize cluster utilization and performance.\nManage serverless SQL warehouses and compute resource governance.\nEstablish and manage connections to diverse source systems (databases, APIs, file systems).\nConfigure and maintain storage integrations (S3, ADLS, GCS, external locations) in addition to setting up and data access patterns.\nImplement and monitor secure credential management and secrets handling.\nand mount points.\nBuild and configure Databricks workspaces, clusters, notebooks, jobs, and Delta Lake storage, integrating with AWS services such as S3, IAM, and KMS.\nImplement and maintain security controls including IAM policies, cluster security configurations, KMS-based encryption, and data masking to protect sensitive data.\nMonitor and tune Databricks clusters and job workloads for reliability, cost optimization, and performance, leveraging autoscaling and workload management.\nApply data governance best practices including cataloging, metadata management, and data lineage using Databricks Unity Catalog and AWS-native capabilities.\nCollaborate with cloud infrastructure teams to configure supporting AWS components such as S3 storage, networking, logging, monitoring, and access controls.\nMaintain detailed technical documentation including solution designs, data flow diagrams, configuration standards, and operational procedures.\nStay up to date with advancements in Databricks, Delta Lake, Spark, and AWS services, integrating new features that improve automation and efficiency.\nPartner with data engineers, analysts, and scientists to implement data models and reusable transformation patterns within Databricks and AWS.\nTroubleshoot and resolve platform-level issues including but not limited to workspace connectivity, cluster startup failures, authentication problems, and infrastructure performance degradation.\nEnsure compliance with data governance, privacy, and security requirements by applying secure architecture patterns and validating controls throughout the data lifecycle.\nSupport the evaluation and hands-on testing of new AWS and Databricks features or services that enhance the Data Lake environment.\n\nSalary Range: $140,000 - $165,000\n\nGeneral Description of Benefits\n\nRequirements:\nAbility to obtain and maintain a DHS Entry on Duty (EOD)/Public Trust\nBachelor's degree +5 years of relevant experience (or 9 years of experience minimum in lieu of degree)\nProven experience in building and configuring enterprise-level data lake solutions using Databricks in an AWS or Azure environment.\nIn-depth knowledge of Databricks architecture, including workspaces, clusters, storage, notebook development, and automation capabilities.\nDeep expertise in Databricks Unity Catalog, workspace management, and security models\nExperience with big data technologies such as Apache Spark, Apache Hive, Delta Lake, and Hadoop.\nSolid understanding of data governance principles, data modeling, data cataloging, and metadata management.\nHands-on experience with cloud platforms like AWS or Azure, including relevant services like S3, EMR, Glue, Data Factory, etc.\nProficiency in SQL and one or more programming languages (Python, Scala, Bash, or PowerShell).\nKnowledge of data security and privacy best practices, including data access controls, encryption, and data masking techniques.\nStrong problem-solving and analytical skills, with the ability to identify and resolve complex data-related issues.\nExcellent interpersonal and communication skills, with the ability to collaborate effectively with technical and non-technical stakeholders.\nExperience in a senior role, providing technical guidance and mentorship to junior team members.\nMust hold a certification such as Databricks Certified Developer or Databricks Certified Professional\n\nReq Benefits:\nBenefits - Everforth ECS","company":"Everforth Ecs","rawCompany":"everforth ecs","city":"Arlington","state":"VA","isRemote":false,"isActive":false,"createdAt":"2026-08-22T16:42:06.267Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Databricks Platform Engineer","description":"Everforth ECS is seeking a Senior Databricks Platform Engineer to work in our Arlington, VA office (Hybrid).\n\nWe are seeking a highly skilled Senior Databricks Platform Engineer to design, implement, and maintain our enterprise-level Databricks platform supporting a federal customer organization's unified data initiative. This role's primary focus is platform management—centered on building scalable infrastructure, governance frameworks, and operational excellence—with secondary responsibilities in data engineering to support platform optimization and best practices.\n\nYou will serve as the steward of our Databricks platform, acting as the frontline technical owner responsible for creating robust, scalable processes and frameworks that enable multiple data teams to work efficiently and securely. This position offers a unique opportunity to work with cutting-edge cloud data technologies and shape the foundational infrastructure of our federal customer's data ecosystem.\n\nResponsibilities:\n\nMaintain enterprise-scale Databricks platform, managing multiple workspaces.\nBuild and maintain platform observability through development of KPIs, executive dashboards, and monitoring solutions that provide visibility into system performance, resource consumption, cost trends, and compliance adherence.\nDevelop and implement scalable user provisioning and de-provisioning processes.\nDesign and manage RBAC (Role-Based Access Control) frameworks and security groups.\nIntegrate with enterprise identity management systems (SAML, SCIM, Active Directory).\nManage Unity Catalog implementation and governance structures.\nOversee metastore configuration, catalog hierarchies, and data organization.\nImplement data lineage, auditing, and compliance frameworks.\nDesign and enforce compute policies, cluster configurations, and pool management strategies.\nImplement cost optimization frameworks and resource allocation policies.\nMonitor and optimize cluster utilization and performance.\nManage serverless SQL warehouses and compute resource governance.\nEstablish and manage connections to diverse source systems (databases, APIs, file systems).\nConfigure and maintain storage integrations (S3, ADLS, GCS, external locations) in addition to setting up and data access patterns.\nImplement and monitor secure credential management and secrets handling.\nand mount points.\nBuild and configure Databricks workspaces, clusters, notebooks, jobs, and Delta Lake storage, integrating with AWS services such as S3, IAM, and KMS.\nImplement and maintain security controls including IAM policies, cluster security configurations, KMS-based encryption, and data masking to protect sensitive data.\nMonitor and tune Databricks clusters and job workloads for reliability, cost optimization, and performance, leveraging autoscaling and workload management.\nApply data governance best practices including cataloging, metadata management, and data lineage using Databricks Unity Catalog and AWS-native capabilities.\nCollaborate with cloud infrastructure teams to configure supporting AWS components such as S3 storage, networking, logging, monitoring, and access controls.\nMaintain detailed technical documentation including solution designs, data flow diagrams, configuration standards, and operational procedures.\nStay up to date with advancements in Databricks, Delta Lake, Spark, and AWS services, integrating new features that improve automation and efficiency.\nPartner with data engineers, analysts, and scientists to implement data models and reusable transformation patterns within Databricks and AWS.\nTroubleshoot and resolve platform-level issues including but not limited to workspace connectivity, cluster startup failures, authentication problems, and infrastructure performance degradation.\nEnsure compliance with data governance, privacy, and security requirements by applying secure architecture patterns and validating controls throughout the data lifecycle.\nSupport the evaluation and hands-on testing of new AWS and Databricks features or services that enhance the Data Lake environment.\n\nSalary Range: $140,000 - $165,000\n\nGeneral Description of Benefits\n\nRequirements:\nAbility to obtain and maintain a DHS Entry on Duty (EOD)/Public Trust\nBachelor's degree +5 years of relevant experience (or 9 years of experience minimum in lieu of degree)\nProven experience in building and configuring enterprise-level data lake solutions using Databricks in an AWS or Azure environment.\nIn-depth knowledge of Databricks architecture, including workspaces, clusters, storage, notebook development, and automation capabilities.\nDeep expertise in Databricks Unity Catalog, workspace management, and security models\nExperience with big data technologies such as Apache Spark, Apache Hive, Delta Lake, and Hadoop.\nSolid understanding of data governance principles, data modeling, data cataloging, and metadata management.\nHands-on experience with cloud platforms like AWS or Azure, including relevant services like S3, EMR, Glue, Data Factory, etc.\nProficiency in SQL and one or more programming languages (Python, Scala, Bash, or PowerShell).\nKnowledge of data security and privacy best practices, including data access controls, encryption, and data masking techniques.\nStrong problem-solving and analytical skills, with the ability to identify and resolve complex data-related issues.\nExcellent interpersonal and communication skills, with the ability to collaborate effectively with technical and non-technical stakeholders.\nExperience in a senior role, providing technical guidance and mentorship to junior team members.\nMust hold a certification such as Databricks Certified Developer or Databricks Certified Professional\n\nReq Benefits:\nBenefits - Everforth ECS","datePosted":"2026-08-22T16:42:06.267Z","dateModified":"2026-08-22T16:42:06.267Z","hiringOrganization":{"@type":"Organization","name":"Everforth Ecs","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Arlington","addressRegion":"VA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"f4e4c99cc0158e786782e3bd"},"url":"https://jobsearcher.com/jobs/f4e4c99cc0158e786782e3bd"}}