{"schemaVersion":"jobsearcher.job.v1","id":"0b9019d6d49a76ddcf285584","url":"https://jobsearcher.com/jobs/0b9019d6d49a76ddcf285584","canonicalUrl":"https://jobsearcher.com/jobs/0b9019d6d49a76ddcf285584","title":"Data Engineer","description":"Description\n\nKey responsibilities\n• Build ingestion into the bronze layer for assigned sources: gateway and observability logs, productivity\ntool admin APIs, AI-enabled SaaS usage, hyperscaler billing exports and reference data. Land raw and\nuntransformed, on a scheduled refresh, replayable if the downstream design changes.\n• Work to the shared bronze landing contract so each tool is ingested once and serves both this program\nand the parallel productivity initiative, rather than being integrated twice.\n• Build the silver layer: typed, deduplicated and conformed to the canonical dimensions, refreshed\nindependently of any downstream publication schedule.\n• Build gold marts carrying attribution method, attribution level, cost basis and provisional status alongside\ncost and usage.\n• Implement the attribution and allocation logic designed by the analysts, including precedence resolution\nand ratio-based splitting of shared endpoint cost.\n• Work within Unity Catalog governance — shared bronze and silver, separate gold marts with a recorded\nowner per dataset — including permissions, lineage and cataloging.\n• Implement data quality rules and monitoring: completeness, freshness and tag-coverage checks with\nalerting, so pipeline problems surface before they reach a divisional invoice.\n• Manage the volume impact of enabling caller-identity data in the cost and usage report, which multiplies\nrow counts by the number of calling identities per model.\n• Work to the per-source cadence — daily where controls and anomaly detection depend on it, monthly\nwhere they do not — within the team's existing CI/CD and promotion practices.\nEssential skills and experience\n• Advanced Databricks engineering: Delta Lake, medallion architecture, Databricks Workflows, Auto\nLoader and incremental ingestion patterns.\n• Unity Catalog to a governance standard — catalogs, schemas, permissions, lineage — not merely as a\nplace tables happen to live.\n• Strong Python and PySpark, and strong SQL. Notebook-based development.\n• Ingestion from REST APIs including pagination, throttling, incremental watermarks and credential\nhandling, plus cloud object storage across AWS, Azure and GCP.\n• Performance and cost optimization of Spark workloads: partitioning, clustering, file sizing and cluster\nconfiguration.\nTokenomics Program - Contract Role Descriptions | Page 7\n• CI/CD for Databricks — asset bundles or equivalent — and Git-based development workflow.\n• Able to work to an existing catalog structure and coding standard rather than introducing a parallel\napproach.","company":"Ness Digital Engineering","rawCompany":"ness digital engineering","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-09-25T11:33:40.321Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1243.00","title":"Database Architects","slug":"database-architects"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Data Engineer","description":"Description\n\nKey responsibilities\n• Build ingestion into the bronze layer for assigned sources: gateway and observability logs, productivity\ntool admin APIs, AI-enabled SaaS usage, hyperscaler billing exports and reference data. Land raw and\nuntransformed, on a scheduled refresh, replayable if the downstream design changes.\n• Work to the shared bronze landing contract so each tool is ingested once and serves both this program\nand the parallel productivity initiative, rather than being integrated twice.\n• Build the silver layer: typed, deduplicated and conformed to the canonical dimensions, refreshed\nindependently of any downstream publication schedule.\n• Build gold marts carrying attribution method, attribution level, cost basis and provisional status alongside\ncost and usage.\n• Implement the attribution and allocation logic designed by the analysts, including precedence resolution\nand ratio-based splitting of shared endpoint cost.\n• Work within Unity Catalog governance — shared bronze and silver, separate gold marts with a recorded\nowner per dataset — including permissions, lineage and cataloging.\n• Implement data quality rules and monitoring: completeness, freshness and tag-coverage checks with\nalerting, so pipeline problems surface before they reach a divisional invoice.\n• Manage the volume impact of enabling caller-identity data in the cost and usage report, which multiplies\nrow counts by the number of calling identities per model.\n• Work to the per-source cadence — daily where controls and anomaly detection depend on it, monthly\nwhere they do not — within the team's existing CI/CD and promotion practices.\nEssential skills and experience\n• Advanced Databricks engineering: Delta Lake, medallion architecture, Databricks Workflows, Auto\nLoader and incremental ingestion patterns.\n• Unity Catalog to a governance standard — catalogs, schemas, permissions, lineage — not merely as a\nplace tables happen to live.\n• Strong Python and PySpark, and strong SQL. Notebook-based development.\n• Ingestion from REST APIs including pagination, throttling, incremental watermarks and credential\nhandling, plus cloud object storage across AWS, Azure and GCP.\n• Performance and cost optimization of Spark workloads: partitioning, clustering, file sizing and cluster\nconfiguration.\nTokenomics Program - Contract Role Descriptions | Page 7\n• CI/CD for Databricks — asset bundles or equivalent — and Git-based development workflow.\n• Able to work to an existing catalog structure and coding standard rather than introducing a parallel\napproach.","datePosted":"2026-09-25T11:33:40.321Z","dateModified":"2026-09-25T11:33:40.321Z","hiringOrganization":{"@type":"Organization","name":"Ness Digital Engineering","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"0b9019d6d49a76ddcf285584"},"url":"https://jobsearcher.com/jobs/0b9019d6d49a76ddcf285584"}}