Software Engineer (Python / Go)
About The Company:
CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. For more information, visit www.coreweave.com.CoreWeave is an AI cloud built for high-performance GPU workloads across AI/ML, VFX, rendering, and real-time inference. Our stack is engineered for speed, scale, and cost efficiency—providing a powerful alternative to traditional hyperscalers. Infrastructure is our product, and we operate it at a massive scale to power the most demanding workloads.
About The Role:
As a Junior Software Engineer (IC1/IC2) on the Inference team at CoreWeave, you will take ownership of a single production service end-to-end. This includes shipping features, maintaining dashboards and alarms, and continuously improving operational excellence. You will collaborate closely with peers across runtime, scheduling, and networking teams to advance key Service Level Indicators (SLIs) and ensure high reliability and performance of our inference platform. This role offers the opportunity to contribute to an industry-defining inference platform that enables teams to deploy generative AI and real-time applications at scale. If you are passionate about optimizing latency, throughput, and delivering reliable model serving, this position provides an excellent environment for growth and impact.
Qualifications:
- 0-3 years of software engineering experience or equivalent, preferably building cloud or distributed services in production environments
- Proficiency in Python or Go programming languages
- Familiarity with gRPC/HTTP APIs and containerized deployments
- Working knowledge of Kubernetes, Slurm, or Ray, and CI/CD pipelines
- Experience with metrics and alerting tools such as Prometheus, Grafana, or Open
- TelemetryExperience with structured logging practices
- Basic understanding of GPU inference concepts including key-value caching, mixed precision, and streaming tokens
Nice to have:
Experience with inference frameworks such as Triton, vLLM, TensorRT-LLM, Ray Serve, or TorchServe
Nice to have:
Hands-on experience with performance profiling and benchmarking tools (e.g., wrk, vegeta, perf, Nsight)
Nice to have:
Contributions to reliability practices such as defining SLIs/SLOs or leading postmortem improvements
Responsibilities:
- Own one model-serving service end-to-end, including design, implementation, testing, deployment, and operational support
- Develop and tune observability tools including dashboards, alerts, and tracing to improve service reliability and reduce manual toil by automating runbook steps
- Optimize latency and throughput through techniques such as micro-batching, concurrency tuning, and caching strategies
- Participate in on-call rotation and lead post-incident action items to ensure continuous service improvement
- Review peer pull requests and contribute constructive design feedback during team code and design reviews
- Collaborate across teams to enhance runtime, scheduling, and networking components impacting inference service performance
Benefits:
- 100% employer-paid medical, dental, and vision insurance
- Company-paid life insurance and voluntary supplemental life insurance options
- Short and long-term disability insurance
- Flexible Spending Account (FSA) and Health Savings Account (HSA) options
- Tuition reimbursement program
- Employee Stock Purchase Program (ESPP) participation
- Mental wellness benefits through Spring HealthFamily-forming support provided by CarrotPaid parental leave
- Flexible, full-service childcare support with Kinside 401(k) plan with a generous employer match
- Flexible paid time off (PTO) policy
- Catered lunch daily at office and data center locations
- A casual work environment fostering curiosity, ownership, and innovation
Equal Opportunity
CoreWeave is an equal opportunity employer committed to fostering an inclusive and supportive workplace. All qualified applicants and candidates will receive consideration for employment without regard to race, color, religion, sex, disability, age, sexual orientation, gender identity, national origin, veteran status, or genetic information.
In compliance with the Americans with Disabilities Act (ADA), CoreWeave will provide reasonable accommodations to qualified applicants and candidates with disabilities throughout the hiring process, unless doing so would cause undue hardship.