Staff Product Manager, AI Inference

Role description

Role Overview

As the Staff Product Manager - AI Inference, you will lead CoreWeave's strategic efforts in shaping and developing cutting-edge AI inference services that drive innovation and business outcomes for our customers. You will collaborate closely with engineers, designers, and industry partners to create world-class products that empower organizations to build, deploy, scale, and optimize AI models and applications efficiently and effectively.

What You Will Do

Key Responsibilities: Product Vision and Strategy, Roadmap Development, AI and Cloud Expertise, Define product portfolio, Customer Engagement, Cross-functional Leadership, Market Analysis, Go-to-Market Strategy.

Why It Might Be a Fit

The ideal candidate is passionate about AI and cloud technologies, with a deep understanding of the foundation model architectures, AI inference landscape, AI application ecosystem, cloud-native technologies, and the competitive landscape.

Requirements

• 8+ years of experience in product management, with at least 5 years in the cloud services or AI/ML market segment
• Hands on practitioner and deep understanding of AI/ML workloads including foundation model inference, inference engines such as vllm, SGLang, TensorRT-llm, and llm-d, inference optimization techniques such as quantization and speculative decoding, cloud infrastructure (GPUs), and cloud-native architectures (Kubernetes, microservices)
• Leadership: Proven ability to lead cross functional teams, with strong decision-making, project management, and mentoring skills
• Customer-Centric Approach: Demonstrated experience working closely with customers to identify needs and translate them into product features and solutions
• Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders
• Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus
• Visionary Leadership: Ability to think strategically while being able to dive into technical details to guide the product team
• Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and cloud space

Benefits

• Medical, dental, and vision insurance - 100% paid for by CoreWeave
• Company-paid Life Insurance
• Voluntary supplemental life insurance
• Short and long-term disability insurance
• Flexible Spending Account
• Health Savings Account
• Tuition Reimbursement
• Ability to Participate in Employee Stock Purchase Program (ESPP)
• Mental Wellness Benefits through Spring Health
• Family-Forming support provided by Carrot
• Paid Parental Leave
• Flexible, full-service childcare support with Kinside
• 401(k) with a generous employer match
• Flexible PTO
• Catered lunch each day in our office and data center locations
• A casual work environment
• A work culture focused on innovative disruption