Research Scientist

Research ScientistEngineering · Full-time · San Francisco; New YorkOur mission is to automate coding. The first step in our journey is to build the best tool for professional programmers, using a combination of inventive research, design, and engineering. Our organization is very flat, and our team is small and talent dense. We particularly like people who are truth-seeking, passionate, and creative. We enjoy spirited debate, crazy ideas, and shipping code.About the roleWe're looking for Research Scientists who can drive effective RL or mid-training research in a small-team setting. You'll own ambiguous, hard research problems end-to-end: forming hypotheses, designing experiments, building the training/eval/data needed to test them, and pushing results into the next model. You should expect significantly more scope and autonomy than in other research labs.What you'll doImprove our understanding of RL, what it takes to handle longer horizon tasks, and train with less computeTrain graders to improve performance on coding tasks with non-verifiable rewardImprove the quality and difficulty of datapoints we use for training our modelsRealtime RL for coding agentsYou may be a fit ifYou have a deep background in RL and strong machine learning fundamentalsYou're an excellent programmer and software engineerYou can handle ambiguous research tasks with little guidanceYou care a lot about data quality, and can dive into the data when appropriateYou are truth seeking, aiming to learn more about the science than proving your ideas are correct.