{"schemaVersion":"jobsearcher.job.v1","id":"148e48b187c78f4df9bb4cb7","url":"https://jobsearcher.com/jobs/148e48b187c78f4df9bb4cb7","canonicalUrl":"https://jobsearcher.com/jobs/148e48b187c78f4df9bb4cb7","title":"Software Engineering Manager","description":"We are looking for Software Engineering Manager to lead the development efforts for the Triton Inference Server team! Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to recommenders to large language models. We are a fast-paced, agile team building tools and software to make design and deployment of new deep learning models easier and accessible to more inference solution providers and data scientists.\r\nIn this role, you will manage an engineering team designing, developing, and optimizing software that streamlines AI inferencing. Ideal candidates will not only have experience leading an agile, system software engineering team, but also be motivated to push the boundaries of what is possible with AI inferencing on both CPUs and GPUs. If this sounds exciting, we would love to hear from you!\r\nWhat you'll be doing:\r\nLead, mentor, and grow the Triton engineering team and be responsible for planning and execution of projects as well as the quality and performance of the Triton Inference Server.\r\nWork closely with Product and Program Management to establish feature roadmaps and coordinate project dependencies; load-balance asynchronous requests across available resources; and collaborate on all feature designs.\r\nEngage with internal and external partners and customers to understand their use cases and requirements.\r\nWhat we need to see\r\nMasters or PhD or equivalent experience in Computer Science, computer architecture, or related field.\r\n8+ years of overall experience in developing customer-facing software.\r\n3+ years of experience recruiting, training, and leading software engineering teams.\r\nStrong fundamentals in building and deploying cloud services using HTTP REST, gRPC, protobuf, and related technologies.\r\nExcellent C/C++ and Python programming and software design skills, including debugging, performance analysis, and test design. Emphasis on clean and SOLID object-oriented programming principles are a plus.\r\nExperience running a large open source project – use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.\r\nExperience with agile software development practices is a requirement, including familiarity with tools such as JIRA and AHA.\r\nWays to stand out from the crowd\r\nExperience working in a globally distributed organization.\r\nExperience with machine learning algorithms and frameworks. Especially experience frameworks such as TensorFlow, PyTorch, ONNX, TensorRT, OpenVino, and vLLM.\r\nGood knowledge of CPU and/or GPU hardware architecture.\r\nKnowledge of GPU programming such as OpenCL or CUDA.\r\nThe base salary range is 216,000 USD - 414,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.\r\nYou will also be eligible for equity and benefits.\r\nNVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.\r\nJ-18808-Ljbffr","company":"NVIDIA","rawCompany":"nvidia","city":"Hillsboro","state":"IL","isRemote":false,"isActive":false,"createdAt":"2026-08-08T01:30:16.664Z","occupations":[{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"11-3021.00","title":"Computer and Information Systems Managers","slug":"computer-and-information-systems-managers"}],"industries":[{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineering Manager","description":"We are looking for Software Engineering Manager to lead the development efforts for the Triton Inference Server team! Academic and commercial groups around the world are using GPUs to power a revolution in deep learning, enabling breakthroughs in problems from image classification to recommenders to large language models. We are a fast-paced, agile team building tools and software to make design and deployment of new deep learning models easier and accessible to more inference solution providers and data scientists.\r\nIn this role, you will manage an engineering team designing, developing, and optimizing software that streamlines AI inferencing. Ideal candidates will not only have experience leading an agile, system software engineering team, but also be motivated to push the boundaries of what is possible with AI inferencing on both CPUs and GPUs. If this sounds exciting, we would love to hear from you!\r\nWhat you'll be doing:\r\nLead, mentor, and grow the Triton engineering team and be responsible for planning and execution of projects as well as the quality and performance of the Triton Inference Server.\r\nWork closely with Product and Program Management to establish feature roadmaps and coordinate project dependencies; load-balance asynchronous requests across available resources; and collaborate on all feature designs.\r\nEngage with internal and external partners and customers to understand their use cases and requirements.\r\nWhat we need to see\r\nMasters or PhD or equivalent experience in Computer Science, computer architecture, or related field.\r\n8+ years of overall experience in developing customer-facing software.\r\n3+ years of experience recruiting, training, and leading software engineering teams.\r\nStrong fundamentals in building and deploying cloud services using HTTP REST, gRPC, protobuf, and related technologies.\r\nExcellent C/C++ and Python programming and software design skills, including debugging, performance analysis, and test design. Emphasis on clean and SOLID object-oriented programming principles are a plus.\r\nExperience running a large open source project – use of GitHub, bug tracking, branching and merging code, OSS licensing issues handling patches, etc.\r\nExperience with agile software development practices is a requirement, including familiarity with tools such as JIRA and AHA.\r\nWays to stand out from the crowd\r\nExperience working in a globally distributed organization.\r\nExperience with machine learning algorithms and frameworks. Especially experience frameworks such as TensorFlow, PyTorch, ONNX, TensorRT, OpenVino, and vLLM.\r\nGood knowledge of CPU and/or GPU hardware architecture.\r\nKnowledge of GPU programming such as OpenCL or CUDA.\r\nThe base salary range is 216,000 USD - 414,000 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.\r\nYou will also be eligible for equity and benefits.\r\nNVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.\r\nJ-18808-Ljbffr","datePosted":"2026-08-08T01:30:16.664Z","dateModified":"2026-08-08T01:30:16.664Z","hiringOrganization":{"@type":"Organization","name":"NVIDIA","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Hillsboro","addressRegion":"IL","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"148e48b187c78f4df9bb4cb7"},"url":"https://jobsearcher.com/jobs/148e48b187c78f4df9bb4cb7"}}