{"schemaVersion":"jobsearcher.job.v1","id":"fc83d244951c4b6948eaa9fd","url":"https://jobsearcher.com/jobs/fc83d244951c4b6948eaa9fd","canonicalUrl":"https://jobsearcher.com/jobs/fc83d244951c4b6948eaa9fd","title":"Software Engineer, Robotics Data","description":"About MercorMercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.About The RoleFrontier AI is going physical, and the labs building it are bottlenecked on one thing: high-quality data from the real world. Mercor pairs its operational scale with the specialized engineering that physical-world data demands.You'll build the data backbone of physical AI: the pipelines that take raw multi-sensor capture from the field (video, depth, inertial, audio, and more) and turn it into validated, privacy-safe, delivery-ready datasets for frontier labs. Ingest, segmentation, pre-labeling, automated QC, and packaging, at petabyte scale across thousands of concurrent collectors.What You'll DoBuild the end-to-end sensor data pipeline: ingest from capture devices in the field, through segmentation, pre-labeling, QC, and packaged delivery to customersDesign automated QC that validates recordings at scale: timing and sync integrity, calibration health, sensor continuity, coverage against requirementsEstablish dataset schemas, versioning, provenance, and versioning, so every delivery has a clear system traceabilityBuild shared processing components such as privacy redaction, transcription, encoding, format packaging across all offeringsIntegrate VLM-assisted pre-labeling and quality scoring into production workflows without sacrificing debuggability or human oversightWhat Makes This Role DifferentHigh ownership, early. This is a young, strategically central product area; the product you build will shape Mercor’s physical-world data collection standardsThe data is the deliverable. The end product at Mercor is the data; what your pipeline produces is what shapes the models that large frontier lab trains onReal physical-world scale. Your inputs come from devices operated by humans in global real world settings, for thousands of hours. Building systems that scale is precedent.What We're Looking ForStrong production backend/data engineering experience — you've built and owned high-volume data pipelinesExperience processing video or sensor data at scale: large binary formats, streaming ingestion, distributed batch processing, object storage economicsFluency in Python and comfortable with AWSGenuine data taste: you can look at a sensor trace or a timing histogram and tell when something is offComfort in ambiguous, fast-moving problem spaces where requirements evolve with the customerNice to HaveExperience with robotics data formats and tooling (MCAP, ROS bags, protobuf, Foxglove), camera geometry, or multi-sensor calibration and synchronizationComputer vision or multimodal ML experience (detection, tracking, VLM-based labeling or QC)Prior work on data engines for AV, robotics, or egocentric videoBenefitsBi-annual performance bonus structureGenerous equity grant vested over 4 yearsUp to $15k Relocation bonus$10K housing bonus (if you live within 0.5 miles of our office)$1.5K monthly stipend for mealsFree Equinox membership$200 monthly laundry reimbursement$200 monthly personal wellness reimbursementHealth, Dental, Vision insuranceCompensation Range: $130K - $500K","company":"Mercor","rawCompany":"mercor","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-07-29T11:22:24.461Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"17-2199.08","title":"Robotics Engineers","slug":"robotics-engineers"},{"code":"15-1251.00","title":"Computer Programmers","slug":"computer-programmers"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineer, Robotics Data","description":"About MercorMercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.Mercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.About The RoleFrontier AI is going physical, and the labs building it are bottlenecked on one thing: high-quality data from the real world. Mercor pairs its operational scale with the specialized engineering that physical-world data demands.You'll build the data backbone of physical AI: the pipelines that take raw multi-sensor capture from the field (video, depth, inertial, audio, and more) and turn it into validated, privacy-safe, delivery-ready datasets for frontier labs. Ingest, segmentation, pre-labeling, automated QC, and packaging, at petabyte scale across thousands of concurrent collectors.What You'll DoBuild the end-to-end sensor data pipeline: ingest from capture devices in the field, through segmentation, pre-labeling, QC, and packaged delivery to customersDesign automated QC that validates recordings at scale: timing and sync integrity, calibration health, sensor continuity, coverage against requirementsEstablish dataset schemas, versioning, provenance, and versioning, so every delivery has a clear system traceabilityBuild shared processing components such as privacy redaction, transcription, encoding, format packaging across all offeringsIntegrate VLM-assisted pre-labeling and quality scoring into production workflows without sacrificing debuggability or human oversightWhat Makes This Role DifferentHigh ownership, early. This is a young, strategically central product area; the product you build will shape Mercor’s physical-world data collection standardsThe data is the deliverable. The end product at Mercor is the data; what your pipeline produces is what shapes the models that large frontier lab trains onReal physical-world scale. Your inputs come from devices operated by humans in global real world settings, for thousands of hours. Building systems that scale is precedent.What We're Looking ForStrong production backend/data engineering experience — you've built and owned high-volume data pipelinesExperience processing video or sensor data at scale: large binary formats, streaming ingestion, distributed batch processing, object storage economicsFluency in Python and comfortable with AWSGenuine data taste: you can look at a sensor trace or a timing histogram and tell when something is offComfort in ambiguous, fast-moving problem spaces where requirements evolve with the customerNice to HaveExperience with robotics data formats and tooling (MCAP, ROS bags, protobuf, Foxglove), camera geometry, or multi-sensor calibration and synchronizationComputer vision or multimodal ML experience (detection, tracking, VLM-based labeling or QC)Prior work on data engines for AV, robotics, or egocentric videoBenefitsBi-annual performance bonus structureGenerous equity grant vested over 4 yearsUp to $15k Relocation bonus$10K housing bonus (if you live within 0.5 miles of our office)$1.5K monthly stipend for mealsFree Equinox membership$200 monthly laundry reimbursement$200 monthly personal wellness reimbursementHealth, Dental, Vision insuranceCompensation Range: $130K - $500K","datePosted":"2026-07-29T11:22:24.461Z","dateModified":"2026-07-29T11:22:24.461Z","hiringOrganization":{"@type":"Organization","name":"Mercor","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"fc83d244951c4b6948eaa9fd"},"url":"https://jobsearcher.com/jobs/fc83d244951c4b6948eaa9fd"}}