Senior Manager, Engineering - AI Inference

Role description

Role Overview

As a Senior Engineering Manager, you will lead an engineering team focused on making large language models run faster, cheaper, and more reliably in production. You will stay deeply technical and hands-on with the inference stack end to end, profiling performance, bringing modern optimization techniques into real deployments, and diving into serving code alongside your engineers.

What You Will Do

Bring current inference techniques into production and refine them, design and optimize serving architectures, work down into the serving stack, adapt and scale optimization methods across many kinds of ML models, and tailor deployments to each customer's models and constraints.

Why It Might Be a Fit

You will be part of a high-performing team that believes in each other, and you will have the opportunity to do the most meaningful work of your career, helping our customers and partners advance their AI strategies.

Requirements

• 2+ years of experience directly managing and leading an engineering team in a high-performance or ML-focused environment
• Strong technical, hands-on experience in software engineering, low-level optimization, or ML infrastructure
• A Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or a related field
• Hands-on experience shipping code in production with one or more general-purpose languages
• Familiarity with methods for optimizing LLMs for high throughput / low latency inference
• Comfort with modern LLM serving frameworks such as vLLM or SGLang, and with profiling and analyzing performance down to the kernel level
• A firm grasp of how GPUs are built and how they behave
• Clear interest and hands-on experience with large language models
• A working knowledge of AI/ML pipelines and the full path of developing and deploying ML models
• Strong communication skills, particularly when explaining hard technical topics to customers and teammates

Benefits

• Competitive compensation and equity packages
• Restricted Stock Units
• Paid time off, paid holidays & leave of absence programs
• Comprehensive health, dental & vision insurance
• Employer contributions to HSA account
• Paid parental leave
• Paid life insurance, short-term and long-term disability
• Professional development & tuition reimbursement
• Mental health & wellness support
• Commuter benefits (parking & transit)
• Cell phone stipend
• 401(k) Retirement plan with company match up to 4% of salary
• Volunteer time off
• Global travel insurance & emergency assistance
• Daily meals allowance
• Additional perks & programs specific to location