Software Engineer, Inference AI/ML

Role description

CoreWeave is seeking a Software Engineer to join their Inference AI/ML team. The ideal candidate will have experience with Python, Go, and C++, as well as a strong foundation in data structures and algorithms. They will be responsible for implementing features and fixes for model-serving services, writing tests and code comments, and participating in code reviews.

Requirements

• BS/MS in CS, EE, or related field, or equivalent practical experience
• Foundations in data structures, algorithms, and networked services
• Experience with Python or Go (C++ a plus) and Linux fundamentals; Git/CI basics
• Exposure to containers and Kubernetes (coursework or projects welcome)
• Curiosity about GPU inference concepts (micro-batching, KV cache, streaming)

Benefits

• Medical, dental, and vision insurance - 100% paid for by CoreWeave
• Company-paid Life Insurance
• Voluntary supplemental life insurance
• Short and long-term disability insurance
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement
• Ability to Participate in Employee Stock Purchase Program (ESPP)
• Mental Wellness Benefits through Spring Health
• Family-Forming support provided by Carrot
• Paid Parental Leave
• Flexible, full-service childcare support with Kinside
• 401(k) with a generous employer match
• Flexible PTO
• Catered lunch each day in our office and data center locations
• A casual work environment
• A work culture focused on innovative disruption