{"schemaVersion":"jobsearcher.job.v1","id":"75fd4e04a92f5df5e0bdfeed","url":"https://jobsearcher.com/jobs/75fd4e04a92f5df5e0bdfeed","canonicalUrl":"https://jobsearcher.com/jobs/75fd4e04a92f5df5e0bdfeed","title":"System Software Engineer - AI","description":"System Software Engineer - AI\nAbout us:\nWe are a stealth-mode startup building foundational technology to address performance, scalability, and resiliency challenges in large-scale AI data center clusters. We are backed by top-tier VC firms and notable angel investors.\nThe company is led by experienced builders and operators who have founded companies, taken them to scale, and exited successfully. We work with a strong sense of unity and shared responsibility, and we expect trust, integrity, and respect in how we collaborate and make decisions. We hold ourselves accountable to one another and to the quality of the work we deliver.\nHeadquartered in Silicon Valley, we operate across a mix of remote and on-site locations in the U.S. and Canada. We aim to create an environment where people are treated fairly, supported in their growth, and are empowered to do meaningful work alongside others who take the craft seriously.\nSome Recent Press:\nhttps://www.eetimes.com/startup-boosts-scale-up-to-1000-gpus-in-a-single-domain/\nWe are looking for:\nWe are looking for a talented System Software Engineer to help us redefine the infrastructure layer of AI. In this role, you will bridge the gap between high-level AI frameworks and low-level system software. You will be responsible for designing and implementing the communication and execution primitives that allow large-scale AI models to run efficiently across thousands of GPUs. We are looking for a \"builder\" who thrives in the early stages of a product’s lifecycle and is passionate about solving the \"hard\" systems problems of the generative AI era.\nKey Responsibilities:\nCollaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next-generation AI models.\nIdentify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface.\nConduct rigorous performance benchmarking and characterization on multi-node clusters.\nRequired Skills and Qualifications:\nStrong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).\nProficient in a Linux development environment.\nDesired Skills:\nExperience with GPU programming (CUDA) and performance optimization for parallel architectures.\nFamiliarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).\nHands-on experience with large-scale cluster orchestration and telemetry tools.\nEducation:\nBachelor's or Master's degree in Computer Engineering, Computer Science, or a related field.\nLocation:\nThis is a hybrid role based in Palo Alto or Charlottesville, VA.\nCompensation:\nTarget base salary for this role is $140,000 - $200,000 per year + meaningful equity + benefits + 401k. Our salary ranges are determined by role, level, experience, and location.\nWe are an equal opportunity employer. We value a range of perspectives and experiences and make employment decisions based on merit and business needs. We do not discriminate on the basis of legally protected characteristics.\nAgency Note:\nWe do not accept resumes from agencies or search firms. Please do not forward candidate profiles through our careers page, email, LinkedIn messages, or directly to company employees. Any resumes submitted will be deemed the property of the company, and no fees will be paid in the event the candidate is hired.\n#LI-EW1","company":"Delos Data","rawCompany":"delos data","city":"Palo Alto","state":"CA","isRemote":false,"isActive":false,"createdAt":"2026-04-09T13:20:47.549Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1211.00","title":"Computer Systems Analysts","slug":"computer-systems-analysts"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"System Software Engineer - AI","description":"System Software Engineer - AI\nAbout us:\nWe are a stealth-mode startup building foundational technology to address performance, scalability, and resiliency challenges in large-scale AI data center clusters. We are backed by top-tier VC firms and notable angel investors.\nThe company is led by experienced builders and operators who have founded companies, taken them to scale, and exited successfully. We work with a strong sense of unity and shared responsibility, and we expect trust, integrity, and respect in how we collaborate and make decisions. We hold ourselves accountable to one another and to the quality of the work we deliver.\nHeadquartered in Silicon Valley, we operate across a mix of remote and on-site locations in the U.S. and Canada. We aim to create an environment where people are treated fairly, supported in their growth, and are empowered to do meaningful work alongside others who take the craft seriously.\nSome Recent Press:\nhttps://www.eetimes.com/startup-boosts-scale-up-to-1000-gpus-in-a-single-domain/\nWe are looking for:\nWe are looking for a talented System Software Engineer to help us redefine the infrastructure layer of AI. In this role, you will bridge the gap between high-level AI frameworks and low-level system software. You will be responsible for designing and implementing the communication and execution primitives that allow large-scale AI models to run efficiently across thousands of GPUs. We are looking for a \"builder\" who thrives in the early stages of a product’s lifecycle and is passionate about solving the \"hard\" systems problems of the generative AI era.\nKey Responsibilities:\nCollaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next-generation AI models.\nIdentify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface.\nConduct rigorous performance benchmarking and characterization on multi-node clusters.\nRequired Skills and Qualifications:\nStrong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).\nProficient in a Linux development environment.\nDesired Skills:\nExperience with GPU programming (CUDA) and performance optimization for parallel architectures.\nFamiliarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).\nHands-on experience with large-scale cluster orchestration and telemetry tools.\nEducation:\nBachelor's or Master's degree in Computer Engineering, Computer Science, or a related field.\nLocation:\nThis is a hybrid role based in Palo Alto or Charlottesville, VA.\nCompensation:\nTarget base salary for this role is $140,000 - $200,000 per year + meaningful equity + benefits + 401k. Our salary ranges are determined by role, level, experience, and location.\nWe are an equal opportunity employer. We value a range of perspectives and experiences and make employment decisions based on merit and business needs. We do not discriminate on the basis of legally protected characteristics.\nAgency Note:\nWe do not accept resumes from agencies or search firms. Please do not forward candidate profiles through our careers page, email, LinkedIn messages, or directly to company employees. Any resumes submitted will be deemed the property of the company, and no fees will be paid in the event the candidate is hired.\n#LI-EW1","datePosted":"2026-04-09T13:20:47.549Z","dateModified":"2026-04-09T13:20:47.549Z","hiringOrganization":{"@type":"Organization","name":"Delos Data","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Palo Alto","addressRegion":"CA","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"75fd4e04a92f5df5e0bdfeed"},"url":"https://jobsearcher.com/jobs/75fd4e04a92f5df5e0bdfeed"}}