{"schemaVersion":"jobsearcher.job.v1","id":"b20ef1dfc4e4f7eac187f7ac","url":"https://jobsearcher.com/jobs/b20ef1dfc4e4f7eac187f7ac","canonicalUrl":"https://jobsearcher.com/jobs/b20ef1dfc4e4f7eac187f7ac","title":"Software Engineer","description":"Senior Engineer (AI Systems)Salary: up to $265kWe are seeking an experienced Senior Distinguished Engineer in AI Systems to help establish the foundations of our enterprise AI capabilities. This role involves a diverse range of initiatives, including designing robust and secure infrastructure, building large-scale distributed training clusters, deploying large language models (LLMs) on GPU instances for real-time applications, and supporting advanced AI research and development within our public cloud infrastructure. You will collaborate with a team of AI engineers and researchers to define the target state of our capabilities while designing and implementing key services.Key Responsibilities:Design and build fault-tolerant infrastructure to support long-running, large-scale training tasks reliably, using containers and check-pointing libraries.Develop infrastructure for serving large machine learning models in our public cloud.Deploy a thousand-node training cluster, optimizing the storage and networking stack with tightly coupled training pipelines to leverage multiple parallelism strategies in our public cloud.Design and implement benchmarks to measure the performance of software systems within AI capabilities and provide recommendations on technology selection.Develop applications that leverage large language models (LLMs) and foundational models (FMs).Design and implement capabilities to support MLOps for foundational models.Qualifications:Basic Qualifications:Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field.At least 7 years of experience in designing and building distributed computing high-performance computing (HPC) and large-scale machine learning (ML) systems.At least 5 years of experience in developing AI and ML algorithms using Python or C/C++.At least 3 years of experience with the full ML development lifecycle using AI and ML frameworks and public cloud environments.Preferred Qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field, or equivalent practical experience with a focus on modern AI techniques.Experience in designing large-scale distributed platforms and systems in cloud environments such as AWS, Azure, or GCP.Expertise in architecting cloud systems for security, availability, performance, scalability, and cost efficiency.Experience in delivering large models through the MLOps lifecycle from exploration to serving.Proficiency in building GPU clusters in the public cloud with tightly coupled storage and networking.Knowledge of the complete stack for distributed training of large models, including ML compilers, distributed training frameworks, and ML development frameworks such as PyTorch, TensorFlow, Lightning, etc.Experience with one or more areas of the AI technology stack, including prompt engineering, guardrails, vector databases/knowledge bases, LLM hosting, and fine-tuning.Authored research publications in top peer-reviewed conferences or industry-recognized contributions in the field of neural networks, distributed training, and SysML.This position is open to remote employees. Join us in pushing the boundaries of AI technology and infrastructure, and help us deliver exceptional AI capabilities to our enterprise.","company":"Gradbay","rawCompany":"gradbay","city":"Denver","state":"CO","isRemote":false,"isActive":false,"createdAt":"2026-08-14T11:07:38.318Z","occupations":[{"code":"15-1299.08","title":"Computer Systems Engineers/Architects","slug":"computer-systems-engineers-architects"},{"code":"15-1252.00","title":"Software Developers","slug":"software-developers"},{"code":"15-1221.00","title":"Computer and Information Research Scientists","slug":"computer-and-information-research-scientists"}],"industries":[{"code":"541512","title":"Computer Systems Design Services","slug":"computer-systems-design-services"},{"code":"513210","title":"Software Publishers","slug":"software-publishers"},{"code":"541511","title":"Custom Computer Programming Services","slug":"custom-computer-programming-services"}],"jobPosting":{"@context":"https://schema.org","@type":"JobPosting","title":"Software Engineer","description":"Senior Engineer (AI Systems)Salary: up to $265kWe are seeking an experienced Senior Distinguished Engineer in AI Systems to help establish the foundations of our enterprise AI capabilities. This role involves a diverse range of initiatives, including designing robust and secure infrastructure, building large-scale distributed training clusters, deploying large language models (LLMs) on GPU instances for real-time applications, and supporting advanced AI research and development within our public cloud infrastructure. You will collaborate with a team of AI engineers and researchers to define the target state of our capabilities while designing and implementing key services.Key Responsibilities:Design and build fault-tolerant infrastructure to support long-running, large-scale training tasks reliably, using containers and check-pointing libraries.Develop infrastructure for serving large machine learning models in our public cloud.Deploy a thousand-node training cluster, optimizing the storage and networking stack with tightly coupled training pipelines to leverage multiple parallelism strategies in our public cloud.Design and implement benchmarks to measure the performance of software systems within AI capabilities and provide recommendations on technology selection.Develop applications that leverage large language models (LLMs) and foundational models (FMs).Design and implement capabilities to support MLOps for foundational models.Qualifications:Basic Qualifications:Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field.At least 7 years of experience in designing and building distributed computing high-performance computing (HPC) and large-scale machine learning (ML) systems.At least 5 years of experience in developing AI and ML algorithms using Python or C/C++.At least 3 years of experience with the full ML development lifecycle using AI and ML frameworks and public cloud environments.Preferred Qualifications:Master’s degree or PhD in Engineering, Computer Science, or a related technical field, or equivalent practical experience with a focus on modern AI techniques.Experience in designing large-scale distributed platforms and systems in cloud environments such as AWS, Azure, or GCP.Expertise in architecting cloud systems for security, availability, performance, scalability, and cost efficiency.Experience in delivering large models through the MLOps lifecycle from exploration to serving.Proficiency in building GPU clusters in the public cloud with tightly coupled storage and networking.Knowledge of the complete stack for distributed training of large models, including ML compilers, distributed training frameworks, and ML development frameworks such as PyTorch, TensorFlow, Lightning, etc.Experience with one or more areas of the AI technology stack, including prompt engineering, guardrails, vector databases/knowledge bases, LLM hosting, and fine-tuning.Authored research publications in top peer-reviewed conferences or industry-recognized contributions in the field of neural networks, distributed training, and SysML.This position is open to remote employees. Join us in pushing the boundaries of AI technology and infrastructure, and help us deliver exceptional AI capabilities to our enterprise.","datePosted":"2026-08-14T11:07:38.318Z","dateModified":"2026-08-14T11:07:38.318Z","hiringOrganization":{"@type":"Organization","name":"Gradbay","sameAs":"https://jobsearcher.com"},"jobLocation":{"@type":"Place","address":{"@type":"PostalAddress","addressLocality":"Denver","addressRegion":"CO","addressCountry":"US"}},"identifier":{"@type":"PropertyValue","name":"JobSearcher","value":"b20ef1dfc4e4f7eac187f7ac"},"url":"https://jobsearcher.com/jobs/b20ef1dfc4e4f7eac187f7ac"}}