Computer Vision, Applied Research Scientist
About BoonBoon is the professional AI platform built specifically for construction. Founded in the San Francisco Bay Area in 2023 by product and engineering leaders from Samsara, Apple, Google and DoorDash. Boon is backed by leading Silicon Valley venture capitalists.Our AI agents embed directly into existing workflows, from preconstruction estimating to bid management. They automate the repetitive tasks that drain time and margins while surfacing the insights leaders need to make faster and more confident decisions.The result is measurable impact. Teams move faster, bids are submitted sooner, win rates increase, and costs are reduced. Boon enables construction companies to build more, generate more revenue, and grow with confidence.About The RoleWe are building the first foundation model for construction drawings — a unified multi-modal vision system that reads, understands, and reasons about architectural, mechanical, electrical, plumbing, and structural plans the way a human estimator does.As a Computer Vision Applied Research Scientist at Boon, you will own end-to-end experiments on our foundation model, from architecture design through self-supervised pretraining, supervised fine-tuning, and shipping production models into our inference pipeline.This is a 50/50 research-to-production role. You will propose new architectures, run the experiments that prove or disprove them, and ship the winning models to real customers. You will have autonomy over direction and experimental ideas, staying aligned with the team and the company's research focus. This is not a role for someone who wants to be told what to build.What Success Looks LikeWithin your first 12-18 months, the successful candidate will:Push our production model to ≥95% accuracy across multiple trades and scopesDesign a genre-defining, novel architecture for construction drawing understandingPublish a paper on the work at a top venue (CVPR, ICCV, ECCV, NeurIPS, or ICLR). We're committed to publishing; we may selectively not release weights or codeWhat You Will DoResearch & ArchitectureDesign and evaluate novel multi-stage vision architectures for construction drawing understanding — perception, text-object association, and relational reasoning across elementsDrive architecture decisions: backbones, decoders, fusion strategies, loss functions, training regimesRun rigorous experiments with clean baselines, ablations, and held-out evaluation on real construction drawingsOwn supervised training and self-supervised pretraining strategiesPursue research directions that compound accuracy across trades and scopesProduction ShippingTake models from experimental notebooks to the production inference pipelineWork hands-on with PyTorch, YOLO, SAM, DINO, and other modern CV stacksCollaborate with ML engineers on deployment, quantization, and servingDebug real failures on real customer drawings and close the loop into the next training runCross-Functional WorkCollaborate with the synthetic data, annotation, and infrastructure teams to make sure experiments have the data and compute they needPartner with engineering leadership on the accuracy roadmap and strategic directionWrite clean internal research reports so the broader team can learn from your workPresent findings, trade-offs, and recommendations to engineering leadershipData & EvaluationHelp shape what data we acquire and annotate, based on what the model actually needsDefine evaluation datasets and metrics that track progress honestly — not Kaggle-style leaderboard chasingIdentify failure modes on real customer drawings and design experiments that address themYou Are a Great Fit IfYou have 3-7+ years of computer vision research experience, ideally with a track record of published papers, open-source work, or production CV modelsYou have deep hands-on experience with multi-modal/vision transformers — segmentation, detection, or joint text+vision tasksYou have worked with modern vision transformer architectures like SAM, DINO, or similar foundation vision modelsYou can move from a research idea to a trained model to a production-shipped system with minimal hand-holdingYou think about experiments rigorously — clean baselines, meaningful ablations, honest evaluation on real dataYou have a point of view on architecture decisions and can defend it with reasoning and experimental evidenceYou thrive on autonomy and set your own direction while staying aligned with team goalsYou communicate clearly in English (written and verbal) and can collaborate during California business hoursRequirements3-7+ years in computer vision research (industry research lab, applied science team, PhD research + industry, or equivalent)Strong track record of published CV research OR trained production CV models that shipped at scaleHands-on expertise in multi-modal dense prediction (segmentation, detection, or joint vision-language tasks)Production experience with modern vision transformer backbones (SAM, DINOv2/v3, CLIP, SigLIP, or similar)Strong PyTorch fluency and experience training large vision modelsAbility to move models from research to production inference pipelinesStrong fundamentals in deep learning: optimization, loss design, regularization, self-supervised learningFluency in English (written and verbal)Nice to HaveExperience with Graph Neural Networks or relational reasoning architectures (we do not expect this — most CV researchers do not — but it is a meaningful plus)Experience with text spotting, OCR, or scene text detection integrated with vision modelsExperience with LoRA, adapters, or parameter-efficient fine-tuning of large vision modelsExperience with self-supervised pretraining (MAE, DINO, or similar)Experience with engineering/technical drawings, document understanding, or layout analysisContributions to open-source CV researchPublished papers at top venues (CVPR, ICCV, ECCV, NeurIPS, ICLR)What we offerDirect ownership of research on a problem nobody in construction AI has solved — the first foundation model for construction drawingsAutonomy to propose, defend, and run your own experiments, shipping the winners to real customersPublication-friendly — we support our team publishing their work at top venuesWork at the intersection of computer vision research and real-world industry impact, in a trillion-dollar marketCollaboration with a world-class team from top tech companies and research institutionsMeaningful equity in an early-stage, well-funded startupCompensationAt Boon, we want to attract and retain the best employees and compensate them in a way that appropriately and fairly values their individual contribution to the company. With that in mind, we carefully consider a number of factors to determine the appropriate starting pay for an employee, including their primary work location and an assessment of a candidate’s skills and experience, as well as market demands and internal parity. This estimate can vary based on the above mentioned factors, so the actual starting annual base salary may be above or below this range. A Boon employee may be eligible for additional forms of compensation, depending on their role, including sales incentives, discretionary bonuses, and/or equity in the company.Boon Is An Equal Opportunity EmployerAs an equal-opportunity employer, Boon is committed to providing employment opportunities to all individuals. All applicants for positions at Boon will be treated without regard to race, color, ethnicity, religion, sex, gender, gender identity and expression, sexual orientation, national origin, disability, age, marital status, veteran status, pregnancy, or any other basis prohibited by applicable law.Compensation Range: $170K - $250K