{"schemaVersion":"jobsearcher.job.v1","id":"09d97504ed4584d95f20cbf7","url":"https://jobsearcher.com/jobs/09d97504ed4584d95f20cbf7","canonicalUrl":"https://jobsearcher.com/jobs/09d97504ed4584d95f20cbf7","title":"Research Operations, Code","description":"About Mercor\nMercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.\n\nMercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.\nAbout the Role\nSilicon Valley's leading AI labs partner with Mercor to build the high-quality code and reasoning data that trains their frontier models. As a member of Research Ops on the Code team, you will own multi-million-dollar data programs end to end — and ownership here is technical as much as operational. You will:\nDecompose frontier model capabilities. Reason about where a lab's frontier coding model is weak, and translate that into the data that will make it stronger.\nDesign the pipeline. Shape how data gets produced — human-expert workflows, synthetic generation, model-in-the-loop systems — not just run a fixed process.\nDrive execution. Turn that design into delivery through a team of expert contributors, under demanding timelines, at a consistently high quality bar.\nOwn the customer. Build deep relationships with lab researchers and become the person they trust to tell them what data they actually need.\nThis role sits at the intersection of operator and builder. You'll spend as much time reasoning about designing tasks which fail frontier models in fair ways, designing verifiers with parity to production codebases, and constructing self-contained environments which capture real world tasks, as you will on delivery and quality. We operate with startup intensity: occasionally responsive on weekends, always a high bar. The upside is that performance incentives, high-slope career trajectory, and meaningful equity reflects that intensity.\nCore Responsibilities\nFrontier Model Evaluation & Data Strategy\nDevelop a working understanding of what our customers' models can and can't do, and where the capability gaps are.\nEvaluate model outputs and benchmark performance, and create targeted loss analysis to identify what data will drive improvement.\nTranslate research goals into concrete task designs, difficulty targets, and quality specifications — including novel frontier tasks that don't exist anywhere else.\nPipeline Design & Innovation\nDesign how data is produced — human-expert, synthetic, and hybrid model-in-the-loop pipelines — and continuously improve them.\nPrototype new generation and validation approaches; bring ideas for new data products, not just improvements to existing ones.\nBalance quality, throughput, and cost as you scale a pipeline from prototype to production.\nOperational Excellence\nManage end-to-end data pipelines from customer specification to final delivery.\nDiagnose bottlenecks, restructure workflows, and implement solutions — incentive systems, workflow re-sequencing, sharper instructions, scaled review processes, and automated quality assurance.\nRun daily internal syncs (\"war rooms\") to stay ahead of issues.\nCustomer Relationships\nAct as the primary point of contact for leading AI labs; deliver clear, consistent reporting.\nProactively anticipate researcher needs and identify opportunities for expansion.\nExpert Teams & Workflow Design\nDesign the human-expert labeling and evaluation flows on the platform — how tasks are structured, reviewed, and scored.\nSource, vet, train, and performance-manage teams of domain experts (software engineers, competitive programmers, and specialists).\nMaintain a high execution and quality standard across every stage of production.\nWhat We're Looking For\nWe hire for range: people who can hold a credible technical conversation with a lab researcher in the morning and design the expert workflow that produces the data in the afternoon.\nRequired\nTechnical judgment. Coding literacy and genuine ML or Model Benchmark familiarity — enough to evaluate model outputs, reason about frontier-model capabilities and failure modes, read benchmark/eval work, and translate research goals into concrete task and data designs. You don't need to be a research scientist, but you do need to go deep on the technical substance.\nOperational ownership. A track record of running complex, high-stakes projects end to end, and genuine energy for large-scale execution and gritty process optimization under pressure.\nCommunication & customer instinct. Strong analytical and communication skills; comfortable owning high-profile relationships with technical customers.\nBonus — a distinctive spike in one of these stands out\nPipeline building: designing data or automation pipelines; hands-on with LLMs/agents; building synthetic-data or model-in-the-loop systems.\nResearch fluency: connecting model/benchmark literature to what data would move a frontier model; having created a benchmark or published analysis of model behavior.\nBackgrounds that often fit: ML/data/software engineers who love operating, technical PMs, research engineers, or strong generalist operators with real technical range. Backgrounds from consulting, finance, or high-growth startups can work if paired with real technical fluency.\nKey Facts\nResearch Ops team members generate $10M+ in project revenue annually.\nCustomer requests are high-pressure and time-sensitive (e.g., standing up a vetted expert team and delivering high-quality data against a lab's spec within days).\nDay-to-day is roughly ~30% customer engagement, ~40–50% data production (pipelines, experts, scaling), and ~15% operations and metrics review.\nThis role blends operational ownership with real technical judgment about models and data. It is not a pure project-management seat, nor a pure research seat.\nLocation: San Francisco (in person, five days a week).\nBenefits\nBi-annual performance bonus structure\nGenerous equity grant vested over 4 years\nUp to $15k Relocation bonus\n$10K housing bonus (if you live within 0.5 miles of our office)\n$1.5K monthly stipend for meals\nFree Equinox membership\n$200 monthly laundry reimbursement\n$200 monthly personal wellness reimbursement\nHealth, Dental, Vision insurance\nCompensation Range: $130K - $250K","company":"Mercor","rawCompany":"mercor","city":"Millbrae","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-07-27T11:10:20.405Z","occupations":[{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-2051.00","title":"Data Scientists","slug":"data-scientists"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"},{"code":"541715","title":"Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology)","slug":"research-and-development-in-the-physical-engineering-and-life-sciences-except-nanotechnology-and-biotechnology"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Research Operations, Code","description":"About Mercor\nMercor's mission is to organize human intelligence to power the AI economy. We're a leading AI data company, building the layer between human expertise and frontier models. Millions of domain experts on the platform are paid over $4 million per day to train frontier AI models. Mercor's APEX benchmark family measures AI's real-world impact on professional work. Mercor Enterprise brings this same infrastructure to Fortune 500 companies: helping companies capture how their best people actually work, translating that expertise directly back into agents.\n\nMercor is creating a new category of work where expertise powers AI advancement. Achieving this requires an ambitious, fast-paced and deeply committed team. You’ll work alongside researchers, operators, and AI companies at the forefront of shaping the systems that are redefining society. Mercor is a profitable Series C company valued at $10 billion. We work in-person five days a week in our San Francisco, NYC, or London offices.\nAbout the Role\nSilicon Valley's leading AI labs partner with Mercor to build the high-quality code and reasoning data that trains their frontier models. As a member of Research Ops on the Code team, you will own multi-million-dollar data programs end to end — and ownership here is technical as much as operational. You will:\nDecompose frontier model capabilities. Reason about where a lab's frontier coding model is weak, and translate that into the data that will make it stronger.\nDesign the pipeline. Shape how data gets produced — human-expert workflows, synthetic generation, model-in-the-loop systems — not just run a fixed process.\nDrive execution. Turn that design into delivery through a team of expert contributors, under demanding timelines, at a consistently high quality bar.\nOwn the customer. Build deep relationships with lab researchers and become the person they trust to tell them what data they actually need.\nThis role sits at the intersection of operator and builder. You'll spend as much time reasoning about designing tasks which fail frontier models in fair ways, designing verifiers with parity to production codebases, and constructing self-contained environments which capture real world tasks, as you will on delivery and quality. We operate with startup intensity: occasionally responsive on weekends, always a high bar. The upside is that performance incentives, high-slope career trajectory, and meaningful equity reflects that intensity.\nCore Responsibilities\nFrontier Model Evaluation & Data Strategy\nDevelop a working understanding of what our customers' models can and can't do, and where the capability gaps are.\nEvaluate model outputs and benchmark performance, and create targeted loss analysis to identify what data will drive improvement.\nTranslate research goals into concrete task designs, difficulty targets, and quality specifications — including novel frontier tasks that don't exist anywhere else.\nPipeline Design & Innovation\nDesign how data is produced — human-expert, synthetic, and hybrid model-in-the-loop pipelines — and continuously improve them.\nPrototype new generation and validation approaches; bring ideas for new data products, not just improvements to existing ones.\nBalance quality, throughput, and cost as you scale a pipeline from prototype to production.\nOperational Excellence\nManage end-to-end data pipelines from customer specification to final delivery.\nDiagnose bottlenecks, restructure workflows, and implement solutions — incentive systems, workflow re-sequencing, sharper instructions, scaled review processes, and automated quality assurance.\nRun daily internal syncs (\"war rooms\") to stay ahead of issues.\nCustomer Relationships\nAct as the primary point of contact for leading AI labs; deliver clear, consistent reporting.\nProactively anticipate researcher needs and identify opportunities for expansion.\nExpert Teams & Workflow Design\nDesign the human-expert labeling and evaluation flows on the platform — how tasks are structured, reviewed, and scored.\nSource, vet, train, and performance-manage teams of domain experts (software engineers, competitive programmers, and specialists).\nMaintain a high execution and quality standard across every stage of production.\nWhat We're Looking For\nWe hire for range: people who can hold a credible technical conversation with a lab researcher in the morning and design the expert workflow that produces the data in the afternoon.\nRequired\nTechnical judgment. Coding literacy and genuine ML or Model Benchmark familiarity — enough to evaluate model outputs, reason about frontier-model capabilities and failure modes, read benchmark/eval work, and translate research goals into concrete task and data designs. You don't need to be a research scientist, but you do need to go deep on the technical substance.\nOperational ownership. A track record of running complex, high-stakes projects end to end, and genuine energy for large-scale execution and gritty process optimization under pressure.\nCommunication & customer instinct. Strong analytical and communication skills; comfortable owning high-profile relationships with technical customers.\nBonus — a distinctive spike in one of these stands out\nPipeline building: designing data or automation pipelines; hands-on with LLMs/agents; building synthetic-data or model-in-the-loop systems.\nResearch fluency: connecting model/benchmark literature to what data would move a frontier model; having created a benchmark or published analysis of model behavior.\nBackgrounds that often fit: ML/data/software engineers who love operating, technical PMs, research engineers, or strong generalist operators with real technical range. Backgrounds from consulting, finance, or high-growth startups can work if paired with real technical fluency.\nKey Facts\nResearch Ops team members generate $10M+ in project revenue annually.\nCustomer requests are high-pressure and time-sensitive (e.g., standing up a vetted expert team and delivering high-quality data against a lab's spec within days).\nDay-to-day is roughly ~30% customer engagement, ~40–50% data production (pipelines, experts, scaling), and ~15% operations and metrics review.\nThis role blends operational ownership with real technical judgment about models and data. It is not a pure project-management seat, nor a pure research seat.\nLocation: San Francisco (in person, five days a week).\nBenefits\nBi-annual performance bonus structure\nGenerous equity grant vested over 4 years\nUp to $15k Relocation bonus\n$10K housing bonus (if you live within 0.5 miles of our office)\n$1.5K monthly stipend for meals\nFree Equinox membership\n$200 monthly laundry reimbursement\n$200 monthly personal wellness reimbursement\nHealth, Dental, Vision insurance\nCompensation Range: $130K - $250K","datePosted":"2026-07-27T11:10:20.405Z","dateModified":"2026-07-27T11:10:20.405Z","hiringOrganization":{"@type":"Organization","name":"Mercor","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Millbrae","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"09d97504ed4584d95f20cbf7"},"url":"https://jobsearcher.com/jobs/09d97504ed4584d95f20cbf7"}}