{"schemaVersion":"jobsearcher.job.v1","id":"c29491e121d0d4ea84771d45","url":"https://jobsearcher.com/jobs/c29491e121d0d4ea84771d45","canonicalUrl":"https://jobsearcher.com/jobs/c29491e121d0d4ea84771d45","title":"Senior Data Engineer - Databricks","description":"Senior Data EngineerThe Sugar Predict platform powers revenue intelligence for mid-market enterprises by fusing ERP and CRM data into actionable insights. As a Senior Data Engineer, you will own the Databricks pipelines that make this possible, driving production reliability, cost efficiency, and platform growth through customer onboarding and legacy modernization. You will work closely with ML engineers, product teams, and the Enterprise Architecture team to ensure the data backbone behind Sugar Predict is always fast, clean, and ready to deliver at a global scale.This role operates on a hybrid model, with a mix of remote work and in-office collaboration at our Denver, CO location, specifically, working in-office a minimum of 2-3 days per week. We are requiring an in-person interview at our downtown Denver office as a part of the hiring process for this role. Note: We are not able to offer Visa Sponsorship at this time.Impact You Will Make in the Role:Own Databricks production support for the Sugar Predict data platform, including monitoring, alerting, and incident response across all production data flowsMaintain and report on SLA performance metrics for data pipeline delivery, ensuring visibility into platform health and accountability across internal and external stakeholdersIdentify and implement pipeline optimizations that reduce Databricks compute costs, improve throughput, and reduce processing windows while tracking impact through measurable KPIsMigrate legacy ETL/ELT pipelines to Databricks, building automation tooling to reduce manual intervention and ensure uninterrupted data delivery during transitionsSupport new customer's onboarding by provisioning, validating, and hardening tenant data pipelines that deliver reliable, isolated data from day oneDesign and build high-performance Databricks pipelines that ingest, transform, and serve ERP and CRM data at scale across both Azure and AWS environmentsOwn the Delta Lake architecture including schema design, partitioning strategies, data quality enforcement, and incremental processing patternsEnforce data security best practices across Databricks environments, including role-based access control, secrets management, Unity Catalog Isolation Attestation Maps, and compliance controls for enterprise CRM and ERP data.Implement data quality monitoring and observability across pipeline health and ML model inputs, ensuring data integrity that directly supports Sugar Predict prediction accuracyApply and enforce multi-tenant data isolation patterns ensuring reliable, secure data delivery across Sugar Predict enterprise customersPartner with the Enterprise Architecture team to ensure Sugar Predict data pipelines integrate seamlessly with the broader SugarAI product ecosystemSupport a globally distributed operation through on-call rotation and after-hours incident response, meeting SLAs across multiple time zonesMaintain technical documentation, runbooks, and architectural decision records, contributing to team knowledge sharing and operational readiness across on-call and incident response scenariosApply CI/CD best practices to data pipeline development, including version control, automated testing, and deployment tooling to ensure reliable and repeatable pipeline deliveryWhat You Will Bring:4+ years of data engineering experienceAt least 2 years on Databricks or the Apache Spark ecosystem across Azure and/or AWSProficiency in PySpark, SQL, and Python with a strong track record building and operating production-grade pipelines under SLA constraintsHands-on experience with Delta Lake including schema evolution, ACID transactions, optimize/vacuum lifecycle, and both incremental and streaming processing patternsHands-on experience with pipeline performance tuning and compute optimization in production Databricks environmentsSolid working knowledge of PostgreSQL including query optimization, schema design, and use as a source or sink in production data pipelinesExperience supporting and maintaining legacy ETL tooling (SSIS, Informatica, custom Python/SQL pipelines, or similar) in productionExperience supporting large-scale multi-tenant architectures with a focus on tenant isolation, per-tenant performance, and data privacy, including navigating tools and platforms that default to single-tenant assumptionsProven ability to work collaboratively across data science, product, and infrastructure teams, owning end-to-end delivery in a cross-functional environmentStrong understanding of data governance, security, and compliance principles, including access control, data privacy, and protection of sensitive enterprise data across multi-tenant environments$155,000 - $185,000 a year Expected salary range, depending on experience.We understand that no candidate is perfectly qualified for any job. Experience comes in different forms; many skills are transferable; and passion goes a long way. Even more important than your resume is a clear demonstration of dedication, impact, and the ability to thrive in a fluid and collaborative environment. We want you to learn new things in this role, and we encourage you to apply if your experience is close to what we're looking for. We also know that diversity of background and thought makes for better problem solving and more creative thinking, which is why we're dedicated to adding new perspectives to the team.Benefits and Perks:Excellent healthcare package for you and your familySavings and Investment – 401(k) matchUnlimited Paid Time OffPaid Parental LeaveOnline Legal Services (Rocket Lawyer)Financial Planning Services (Origin)Discounted Pet Insurance (Embrace Pet Insurance)Corporate Benefit Program (Working Advantage). This benefit offers you exclusive travel and entertainment offers and special discounts that are not available to the general publicHealth and Wellness Reimbursement ProgramTravel DiscountsEducational Resources - Career & Personal Development ProgramEmployee Referral Bonus ProgramWe are a merit-based company - many opportunities to learn, excel and grow your career!If you require a reasonable accommodation to search for a job opening or submit an application, please call +1 (877) 842-7276 with your request and contact information.Our company uses E-Verify to confirm the employment eligibility of all newly hired employees. To learn more about E-Verify, including your rights and responsibilities, please visit www.dhs.gov/E-Verify.","company":"Sugarcrm","rawCompany":"sugarcrm","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-08-25T04:26:49.781Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Senior Data Engineer - Databricks","description":"Senior Data EngineerThe Sugar Predict platform powers revenue intelligence for mid-market enterprises by fusing ERP and CRM data into actionable insights. As a Senior Data Engineer, you will own the Databricks pipelines that make this possible, driving production reliability, cost efficiency, and platform growth through customer onboarding and legacy modernization. You will work closely with ML engineers, product teams, and the Enterprise Architecture team to ensure the data backbone behind Sugar Predict is always fast, clean, and ready to deliver at a global scale.This role operates on a hybrid model, with a mix of remote work and in-office collaboration at our Denver, CO location, specifically, working in-office a minimum of 2-3 days per week. We are requiring an in-person interview at our downtown Denver office as a part of the hiring process for this role. Note: We are not able to offer Visa Sponsorship at this time.Impact You Will Make in the Role:Own Databricks production support for the Sugar Predict data platform, including monitoring, alerting, and incident response across all production data flowsMaintain and report on SLA performance metrics for data pipeline delivery, ensuring visibility into platform health and accountability across internal and external stakeholdersIdentify and implement pipeline optimizations that reduce Databricks compute costs, improve throughput, and reduce processing windows while tracking impact through measurable KPIsMigrate legacy ETL/ELT pipelines to Databricks, building automation tooling to reduce manual intervention and ensure uninterrupted data delivery during transitionsSupport new customer's onboarding by provisioning, validating, and hardening tenant data pipelines that deliver reliable, isolated data from day oneDesign and build high-performance Databricks pipelines that ingest, transform, and serve ERP and CRM data at scale across both Azure and AWS environmentsOwn the Delta Lake architecture including schema design, partitioning strategies, data quality enforcement, and incremental processing patternsEnforce data security best practices across Databricks environments, including role-based access control, secrets management, Unity Catalog Isolation Attestation Maps, and compliance controls for enterprise CRM and ERP data.Implement data quality monitoring and observability across pipeline health and ML model inputs, ensuring data integrity that directly supports Sugar Predict prediction accuracyApply and enforce multi-tenant data isolation patterns ensuring reliable, secure data delivery across Sugar Predict enterprise customersPartner with the Enterprise Architecture team to ensure Sugar Predict data pipelines integrate seamlessly with the broader SugarAI product ecosystemSupport a globally distributed operation through on-call rotation and after-hours incident response, meeting SLAs across multiple time zonesMaintain technical documentation, runbooks, and architectural decision records, contributing to team knowledge sharing and operational readiness across on-call and incident response scenariosApply CI/CD best practices to data pipeline development, including version control, automated testing, and deployment tooling to ensure reliable and repeatable pipeline deliveryWhat You Will Bring:4+ years of data engineering experienceAt least 2 years on Databricks or the Apache Spark ecosystem across Azure and/or AWSProficiency in PySpark, SQL, and Python with a strong track record building and operating production-grade pipelines under SLA constraintsHands-on experience with Delta Lake including schema evolution, ACID transactions, optimize/vacuum lifecycle, and both incremental and streaming processing patternsHands-on experience with pipeline performance tuning and compute optimization in production Databricks environmentsSolid working knowledge of PostgreSQL including query optimization, schema design, and use as a source or sink in production data pipelinesExperience supporting and maintaining legacy ETL tooling (SSIS, Informatica, custom Python/SQL pipelines, or similar) in productionExperience supporting large-scale multi-tenant architectures with a focus on tenant isolation, per-tenant performance, and data privacy, including navigating tools and platforms that default to single-tenant assumptionsProven ability to work collaboratively across data science, product, and infrastructure teams, owning end-to-end delivery in a cross-functional environmentStrong understanding of data governance, security, and compliance principles, including access control, data privacy, and protection of sensitive enterprise data across multi-tenant environments$155,000 - $185,000 a year Expected salary range, depending on experience.We understand that no candidate is perfectly qualified for any job. Experience comes in different forms; many skills are transferable; and passion goes a long way. Even more important than your resume is a clear demonstration of dedication, impact, and the ability to thrive in a fluid and collaborative environment. We want you to learn new things in this role, and we encourage you to apply if your experience is close to what we're looking for. We also know that diversity of background and thought makes for better problem solving and more creative thinking, which is why we're dedicated to adding new perspectives to the team.Benefits and Perks:Excellent healthcare package for you and your familySavings and Investment – 401(k) matchUnlimited Paid Time OffPaid Parental LeaveOnline Legal Services (Rocket Lawyer)Financial Planning Services (Origin)Discounted Pet Insurance (Embrace Pet Insurance)Corporate Benefit Program (Working Advantage). This benefit offers you exclusive travel and entertainment offers and special discounts that are not available to the general publicHealth and Wellness Reimbursement ProgramTravel DiscountsEducational Resources - Career & Personal Development ProgramEmployee Referral Bonus ProgramWe are a merit-based company - many opportunities to learn, excel and grow your career!If you require a reasonable accommodation to search for a job opening or submit an application, please call +1 (877) 842-7276 with your request and contact information.Our company uses E-Verify to confirm the employment eligibility of all newly hired employees. To learn more about E-Verify, including your rights and responsibilities, please visit www.dhs.gov/E-Verify.","datePosted":"2026-08-25T04:26:49.781Z","dateModified":"2026-08-25T04:26:49.781Z","hiringOrganization":{"@type":"Organization","name":"Sugarcrm","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"c29491e121d0d4ea84771d45"},"url":"https://jobsearcher.com/jobs/c29491e121d0d4ea84771d45"}}