JOBSEARCHER

Senior Software Engineer, Technical Code Evaluation and Root Cause Analysis

ARCHIVED

We can't find an active application page for this role right now. It may reopen or be listed elsewhere. Use Next Steps to search for an active apply link and similar live jobs.

๐—ง๐—ต๐—ถ๐˜€ ๐—ถ๐˜€ ๐—ป๐—ผ๐˜ ๐—ฎ ๐—ฐ๐—ผ๐—ฑ๐—ถ๐—ป๐—ด ๐—ท๐—ผ๐—ฏ. ๐—œ๐˜ ๐—ถ๐˜€ ๐—ฎ ๐—ท๐˜‚๐—ฑ๐—ด๐—บ๐—ฒ๐—ป๐˜ ๐—ท๐—ผ๐—ฏ. ๐—ฌ๐—ผ๐˜‚ ๐˜„๐—ถ๐—น๐—น ๐—ป๐—ผ๐˜ ๐˜€๐—ต๐—ถ๐—ฝ ๐—ณ๐—ฒ๐—ฎ๐˜๐˜‚๐—ฟ๐—ฒ๐˜€ ๐—ต๐—ฒ๐—ฟ๐—ฒ.You will read what a coding agent did across an entire session on a real production codebase, work out exactly where its solution falls short, and write up why. To do that you need years of hands-on engineering behind you. The deliverable is your analysis, not your commits.๐—ง๐—›๐—˜ ๐—–๐—Ÿ๐—œ๐—˜๐—ก๐—งPave Talent is hiring on behalf of a frontier artificial intelligence (AI) research lab. This is a contract engagement through their staffing partner.๐—ง๐—›๐—˜ ๐—ช๐—ข๐—ฅ๐—ž- Review a coding agent's full session, not the final diff. What it investigated, what it verified, what it assumed, what it left undone- Locate where model-generated code breaks and explain precisely why, in writing a researcher can act on- Build the evaluation problems these models get tested against- Reproduce builds and failures locally in containers- Work directly with researchers on questions they are investigating right now๐—ง๐—›๐—˜ ๐—ฆ๐—–๐—›๐—˜๐——๐—จ๐—Ÿ๐—˜, ๐—”๐—ก๐—— ๐—ช๐—›๐—ฌ ๐—ฃ๐—˜๐—ข๐—ฃ๐—Ÿ๐—˜ ๐—ง๐—”๐—ž๐—˜ ๐—ง๐—›๐—œ๐—ฆ30 to 40 hours a week, and you choose when. Weekday evenings. Weekends. A standard Monday to Friday week if you prefer. Some people on this project keep their full-time job and run this alongside it. Others do it as a straight 40-hour week. Both work.๐—ช๐—›๐—”๐—ง ๐—ช๐—˜ ๐—”๐—ฅ๐—˜ ๐—Ÿ๐—ข๐—ข๐—ž๐—œ๐—ก๐—š ๐—™๐—ข๐—ฅ- 6+ years writing production code, hands-on. Not managing people who write it- Heavy code review history. You are the person on your team who catches what continuous integration (CI) and the author both missed- Comfort in unfamiliar repos and languages outside your daily stack. The codebases rotate weekly- Working fluency with Docker or equivalent, reproducing builds and failures locally- You write clearly. If you cannot explain why a solution is wrong, the analysis has no value- United States work authorization, no sponsorship๐——๐—ข ๐—ก๐—ข๐—ง ๐—”๐—ฃ๐—ฃ๐—Ÿ๐—ฌ ๐—œ๐—™ ๐—”๐—ก๐—ฌ ๐—ข๐—™ ๐—ง๐—›๐—˜๐—ฆ๐—˜ ๐—”๐—ฅ๐—˜ ๐—ง๐—ฅ๐—จ๐—˜We would rather say this plainly than waste your time or ours.- You have not written production code in the last two years- You are not willing to sit a proctored coding assessment with one attempt- You are not willing to verify your identity on video before submission- You need someone else to interview or work on your behalf- You are outside the United States๐—›๐—ข๐—ช ๐—ช๐—˜ ๐—ฆ๐—–๐—ฅ๐—˜๐—˜๐—กThree steps, in this order, and no exceptions for anyone.1. Technical video screening with us2. Identity verification. You record a brief video holding a government photo ID. You may mask everything except your photo and name3. A CodeSignal Industry Coding Assessment. One attempt, roughly 90 minutes to 2 hours, minimum score 500. We send prep material in advanceAfter onboarding there are two further assessments the lab built, over about two weeks, that determine whether you continue on the project.๐—ง๐—˜๐—ฅ๐— ๐—ฆ๐—ฃ๐—ฎ๐˜†: $150 per hour, W-2. No corp-to-corp, no 1099 ๐—›๐—ผ๐˜‚๐—ฟ๐˜€: 30 to 40 per week, scheduled by you๐—Ÿ๐—ฒ๐—ป๐—ด๐˜๐—ต: 6-month contract. Conversion to a permanent role is unlikely, and you should hear that now๐—Ÿ๐—ผ๐—ฐ๐—ฎ๐˜๐—ถ๐—ผ๐—ป: Fully remote, United States onlyApply through LinkedIn. Answer the screening questions honestly. Every answer gets verified.๐—ฃ๐—ฎ๐˜ƒ๐—ฒ ๐—ง๐—ฎ๐—น๐—ฒ๐—ป๐˜ | ๐—›๐—ถ๐—ฟ๐—ถ๐—ป๐—ด ๐—ฅ๐—ฒ๐—ถ๐—บ๐—ฎ๐—ด๐—ถ๐—ป๐—ฒ๐—ฑ