{"schemaVersion":"jobsearcher.job.v1","id":"56acffc8cd4c8bfaac7ad341","url":"https://jobsearcher.com/jobs/56acffc8cd4c8bfaac7ad341","canonicalUrl":"https://jobsearcher.com/jobs/56acffc8cd4c8bfaac7ad341","title":"Principal Databricks Architect","description":"About This Role\nBounteous is a global AI Services firm where agentic engineering and human experience converge to deliver transformative business outcomes for the enterprise. We help organizations design, build, and scale AI-driven products, platforms, and processes. With more than 5,000 team members worldwide, Bounteous delivers AI that sticks, powering adoption and outcomes that move organizations from experimentation to true transformation. Bounteous is backed by New Mountain Capital, a New York-based growth-oriented investment firm that emphasizes business building.\n\nWe are seeking a Lead Databricks Engineer/Architect to design, build, and scale our cloud-based lakehouse platform. In this role, you will own the end-to-end architecture of our data ecosystem on Databricks, partner with data science and analytics teams to productionize ML and analytical workloads, and set the technical direction for ingestion, transformation, governance, and performance optimization across petabyte-scale datasets. You will be a hands-on technical leader: writing production code, mentoring engineers, and shaping standards that the broader data organization will adopt.\nInformation Security Responsibilities\nPromote and enforce awareness of key information security practices, including acceptable use of information assets, malware protection, and password security protocols\nIdentify, assess, and report security risks, focusing on how these risks impact the confidentiality, integrity, and availability of information assets\nUnderstand and evaluate how data is stored, processed, or transmitted, ensuring compliance with data privacy and protection standards (GDPR, CCPA, etc.)\nEnsure data protection measures are integrated throughout the information lifecycle to safeguard sensitive information\nRole and Responsibilities\nArchitect and lead the implementation of an enterprise lakehouse on Databricks (Delta Lake, Unity Catalog, Photon, Workflows) across one or more major clouds (AWS, Azure, or GCP).\nDesign scalable batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and Delta Live Tables; establish patterns for ingestion from operational systems, event streams, and third-party APIs.\nDefine and enforce platform standards for data modeling (medallion architecture), CI/CD, code quality, testing, observability, and cost optimization.\nLead the governance strategy using Unity Catalog — fine-grained access control, data lineage, audit, and PII handling — in partnership with security and compliance.\nOptimize Spark workloads for performance and cost: cluster sizing, Photon, autoscaling, file layout, Z-ordering, caching, and query tuning.\nPartner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving on Databricks.\nOwn the cloud infrastructure footprint for the platform: networking, IAM, secrets, encryption, and Terraform/IaC for Databricks workspaces and supporting services.\nMentor a team of data engineers; lead architecture reviews, code reviews, and technical design sessions; raise the bar on engineering practices.\nEngage with stakeholders across analytics, product, and finance to translate business needs into a roadmap for the data platform.\nAbility to travel around once a month\nRequired Qualifications\n10+ years of data engineering experience, with 4+ years building production workloads on Databricks.\nDeep expertise in Apache Spark (PySpark and Spark SQL) — including performance tuning, partitioning strategy, and the Catalyst/Photon execution model.\nStrong hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.\nProduction experience on at least one major cloud (AWS, Azure, or GCP), including networking, IAM, storage (S3/ADLS/GCS), and compute primitives.\nProficiency in Python and SQL; comfort with Scala is a plus.\nExperience designing medallion (bronze/silver/gold) architectures and dimensional models for analytics.\nStrong CI/CD and DevOps practice: Git, Terraform, Databricks Asset Bundles or dbx, automated testing of data pipelines.\nTrack record of leading technical projects end-to-end and mentoring engineers.\nExcellent written and verbal communication; able to drive alignment with both engineering and business stakeholders.\nPreferred Qualifiactions\nDatabricks certifications (Data Engineer Professional, Machine Learning Professional, or Solutions Architect).\nExperience with streaming architectures (Kafka, Kinesis, Event Hubs, Pub/Sub) and Structured Streaming at scale.\nExperience with MLflow, feature stores, and ML model deployment patterns.\nFamiliarity with dbt, Airflow, or other orchestration/transformation tools alongside Databricks.\nExperience migrating legacy data warehouses (Teradata, Netezza, on-prem Hadoop, Snowflake) to Databricks.\nMulti-cloud or hybrid-cloud experience.\nExperience operating under regulated frameworks (SOC 2, HIPAA, GDPR, PCI).\nAbility to travel around once a month\nWhat You'll Bring\nAn architect's instinct for trade-offs — balancing speed, cost, complexity, and long-term maintainability.\nA bias toward writing things down: design docs, ADRs, runbooks, and onboarding guides.\nComfort operating with ambiguity and shaping problems before solving them.\nA collaborative, mentorship-oriented leadership style.\nWe invite you to stay connected with us by subscribing to our monthly job openings alert here.\nBounteous is proud to be an equal opportunity employer. Bounteous does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, physical or mental disability, national origin, veteran status, or any other status protected under federal, state, or local law. Bounteous is willing to sponsor eligible candidates for employment visas.\n#BI-Remote\n#LI-Remote\nSalary Range\nMinimum\n$190,000\nMaximum\n$200,000\nCurrency\nUSD\nInterval\nAnnually\nIndividual pay is determined by many factors, including experience, relevant education or training, and organizational needs. The mid-range to maximum of the salary range is generally reserved for individuals who are highly experienced in the role.","company":"Bounteous","rawCompany":"bounteous","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-08-14T13:03:43.762Z","occupations":[{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"},{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Principal Databricks Architect","description":"About This Role\nBounteous is a global AI Services firm where agentic engineering and human experience converge to deliver transformative business outcomes for the enterprise. We help organizations design, build, and scale AI-driven products, platforms, and processes. With more than 5,000 team members worldwide, Bounteous delivers AI that sticks, powering adoption and outcomes that move organizations from experimentation to true transformation. Bounteous is backed by New Mountain Capital, a New York-based growth-oriented investment firm that emphasizes business building.\n\nWe are seeking a Lead Databricks Engineer/Architect to design, build, and scale our cloud-based lakehouse platform. In this role, you will own the end-to-end architecture of our data ecosystem on Databricks, partner with data science and analytics teams to productionize ML and analytical workloads, and set the technical direction for ingestion, transformation, governance, and performance optimization across petabyte-scale datasets. You will be a hands-on technical leader: writing production code, mentoring engineers, and shaping standards that the broader data organization will adopt.\nInformation Security Responsibilities\nPromote and enforce awareness of key information security practices, including acceptable use of information assets, malware protection, and password security protocols\nIdentify, assess, and report security risks, focusing on how these risks impact the confidentiality, integrity, and availability of information assets\nUnderstand and evaluate how data is stored, processed, or transmitted, ensuring compliance with data privacy and protection standards (GDPR, CCPA, etc.)\nEnsure data protection measures are integrated throughout the information lifecycle to safeguard sensitive information\nRole and Responsibilities\nArchitect and lead the implementation of an enterprise lakehouse on Databricks (Delta Lake, Unity Catalog, Photon, Workflows) across one or more major clouds (AWS, Azure, or GCP).\nDesign scalable batch and streaming data pipelines using PySpark, Spark SQL, Structured Streaming, and Delta Live Tables; establish patterns for ingestion from operational systems, event streams, and third-party APIs.\nDefine and enforce platform standards for data modeling (medallion architecture), CI/CD, code quality, testing, observability, and cost optimization.\nLead the governance strategy using Unity Catalog — fine-grained access control, data lineage, audit, and PII handling — in partnership with security and compliance.\nOptimize Spark workloads for performance and cost: cluster sizing, Photon, autoscaling, file layout, Z-ordering, caching, and query tuning.\nPartner with ML engineers and data scientists to operationalize models using MLflow, feature stores, and model serving on Databricks.\nOwn the cloud infrastructure footprint for the platform: networking, IAM, secrets, encryption, and Terraform/IaC for Databricks workspaces and supporting services.\nMentor a team of data engineers; lead architecture reviews, code reviews, and technical design sessions; raise the bar on engineering practices.\nEngage with stakeholders across analytics, product, and finance to translate business needs into a roadmap for the data platform.\nAbility to travel around once a month\nRequired Qualifications\n10+ years of data engineering experience, with 4+ years building production workloads on Databricks.\nDeep expertise in Apache Spark (PySpark and Spark SQL) — including performance tuning, partitioning strategy, and the Catalyst/Photon execution model.\nStrong hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and Delta Live Tables.\nProduction experience on at least one major cloud (AWS, Azure, or GCP), including networking, IAM, storage (S3/ADLS/GCS), and compute primitives.\nProficiency in Python and SQL; comfort with Scala is a plus.\nExperience designing medallion (bronze/silver/gold) architectures and dimensional models for analytics.\nStrong CI/CD and DevOps practice: Git, Terraform, Databricks Asset Bundles or dbx, automated testing of data pipelines.\nTrack record of leading technical projects end-to-end and mentoring engineers.\nExcellent written and verbal communication; able to drive alignment with both engineering and business stakeholders.\nPreferred Qualifiactions\nDatabricks certifications (Data Engineer Professional, Machine Learning Professional, or Solutions Architect).\nExperience with streaming architectures (Kafka, Kinesis, Event Hubs, Pub/Sub) and Structured Streaming at scale.\nExperience with MLflow, feature stores, and ML model deployment patterns.\nFamiliarity with dbt, Airflow, or other orchestration/transformation tools alongside Databricks.\nExperience migrating legacy data warehouses (Teradata, Netezza, on-prem Hadoop, Snowflake) to Databricks.\nMulti-cloud or hybrid-cloud experience.\nExperience operating under regulated frameworks (SOC 2, HIPAA, GDPR, PCI).\nAbility to travel around once a month\nWhat You'll Bring\nAn architect's instinct for trade-offs — balancing speed, cost, complexity, and long-term maintainability.\nA bias toward writing things down: design docs, ADRs, runbooks, and onboarding guides.\nComfort operating with ambiguity and shaping problems before solving them.\nA collaborative, mentorship-oriented leadership style.\nWe invite you to stay connected with us by subscribing to our monthly job openings alert here.\nBounteous is proud to be an equal opportunity employer. Bounteous does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, physical or mental disability, national origin, veteran status, or any other status protected under federal, state, or local law. Bounteous is willing to sponsor eligible candidates for employment visas.\n#BI-Remote\n#LI-Remote\nSalary Range\nMinimum\n$190,000\nMaximum\n$200,000\nCurrency\nUSD\nInterval\nAnnually\nIndividual pay is determined by many factors, including experience, relevant education or training, and organizational needs. The mid-range to maximum of the salary range is generally reserved for individuals who are highly experienced in the role.","datePosted":"2026-08-14T13:03:43.762Z","dateModified":"2026-08-14T13:03:43.762Z","hiringOrganization":{"@type":"Organization","name":"Bounteous","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"56acffc8cd4c8bfaac7ad341"},"url":"https://jobsearcher.com/jobs/56acffc8cd4c8bfaac7ad341"}}