{"schemaVersion":"jobsearcher.job.v1","id":"7499badfd7d0f32bdac1059a","url":"https://jobsearcher.com/jobs/7499badfd7d0f32bdac1059a","canonicalUrl":"https://jobsearcher.com/jobs/7499badfd7d0f32bdac1059a","title":"MTS - Pre-Training Data & Acquisition Engineer","description":"The Role\n\nWe’re hiring a Pre-Training Data & Acquisition Engineer to build the data systems powering Prometheus’s foundation models for the physical world. You’ll work closely with research and infrastructure teams to acquire, process, and deliver large-scale training datasets across engineering, scientific, and multimodal domains. This role spans distributed crawling, source integration, data processing, and production operation, with end-to-end ownership from raw content to training-ready datasets.\n\nWhat You’ll Do\n\nIdentify and integrate valuable data sources across engineering and scientific domains.\n\nBuild distributed crawlers, API integrations, and bulk ingestion systems with effective scheduling, rate limiting, retries, and incremental updates.\n\nDevelop pipelines for parsing, extraction, normalization, deduplication, quality filtering, and tokenization across heterogeneous formats.\n\nOptimize throughput and cost across networking, compute, storage, and databases as acquisition and processing workloads scale.\n\nBuild monitoring and tooling to track source coverage, ingestion failures, processing throughput, and usable data yield.\n\nWork closely with pre-training researchers to translate data requirements into reliable pipelines and deliver datasets ready for large-scale training.\n\nOwn dataset reproducibility, versioning, provenance, and recovery from acquisition through delivery.\n\nWhat We’re Looking For\n\nExperience building and operating large-scale distributed systems, web crawlers, or data processing pipelines.\n\nStrong programming ability in Python and Rust, Go, C++, or a comparable systems language.\n\nA practical understanding of web infrastructure, including HTTP, DNS, concurrency, caching, and common failure modes.\n\nHands-on experience with databases, object storage, and distributed batch or streaming processing.\n\nExperience designing fault-tolerant systems that handle partial failures, resume interrupted work, and prevent unintended duplication or data loss.\n\nAbility to profile and debug performance across CPU, memory, disk, and network usage.\n\nStrong technical judgment when integrating unfamiliar sources, APIs, and file formats.\n\nBias toward fast iteration and end-to-end ownership, from initial implementation through reliable production operation.\n\nExperience with search indexing, document extraction, or foundation-model data pipelines is a plus.\n\nWhy Join Us\n\nWork with world-class researchers on frontier AI systems for the physical world.\n\nBuild the acquisition and processing systems that supply engineering, scientific, and multimodal data to large-scale model training.\n\nCompetitive compensation and flexible work arrangements.\n\nHigh-impact, mission-driven environment.","company":"Prometheus","rawCompany":"prometheus","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-10-09T10:50:31.361Z","occupations":[{"code":"15-1243.01","title":"Data Warehousing Specialists","slug":"data-warehousing-specialists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"518210","title":"Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services","slug":"computing-infrastructure-providers-data-processing-web-hosting-and-related-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"MTS - Pre-Training Data & Acquisition Engineer","description":"The Role\n\nWe’re hiring a Pre-Training Data & Acquisition Engineer to build the data systems powering Prometheus’s foundation models for the physical world. You’ll work closely with research and infrastructure teams to acquire, process, and deliver large-scale training datasets across engineering, scientific, and multimodal domains. This role spans distributed crawling, source integration, data processing, and production operation, with end-to-end ownership from raw content to training-ready datasets.\n\nWhat You’ll Do\n\nIdentify and integrate valuable data sources across engineering and scientific domains.\n\nBuild distributed crawlers, API integrations, and bulk ingestion systems with effective scheduling, rate limiting, retries, and incremental updates.\n\nDevelop pipelines for parsing, extraction, normalization, deduplication, quality filtering, and tokenization across heterogeneous formats.\n\nOptimize throughput and cost across networking, compute, storage, and databases as acquisition and processing workloads scale.\n\nBuild monitoring and tooling to track source coverage, ingestion failures, processing throughput, and usable data yield.\n\nWork closely with pre-training researchers to translate data requirements into reliable pipelines and deliver datasets ready for large-scale training.\n\nOwn dataset reproducibility, versioning, provenance, and recovery from acquisition through delivery.\n\nWhat We’re Looking For\n\nExperience building and operating large-scale distributed systems, web crawlers, or data processing pipelines.\n\nStrong programming ability in Python and Rust, Go, C++, or a comparable systems language.\n\nA practical understanding of web infrastructure, including HTTP, DNS, concurrency, caching, and common failure modes.\n\nHands-on experience with databases, object storage, and distributed batch or streaming processing.\n\nExperience designing fault-tolerant systems that handle partial failures, resume interrupted work, and prevent unintended duplication or data loss.\n\nAbility to profile and debug performance across CPU, memory, disk, and network usage.\n\nStrong technical judgment when integrating unfamiliar sources, APIs, and file formats.\n\nBias toward fast iteration and end-to-end ownership, from initial implementation through reliable production operation.\n\nExperience with search indexing, document extraction, or foundation-model data pipelines is a plus.\n\nWhy Join Us\n\nWork with world-class researchers on frontier AI systems for the physical world.\n\nBuild the acquisition and processing systems that supply engineering, scientific, and multimodal data to large-scale model training.\n\nCompetitive compensation and flexible work arrangements.\n\nHigh-impact, mission-driven environment.","datePosted":"2026-10-09T10:50:31.361Z","dateModified":"2026-10-09T10:50:31.361Z","hiringOrganization":{"@type":"Organization","name":"Prometheus","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"7499badfd7d0f32bdac1059a"},"url":"https://jobsearcher.com/jobs/7499badfd7d0f32bdac1059a"}}