Senior Staff Applied AI Inference Engineer
Crusoe — San Francisco, California, United States · In-Person · Staff+ · $250k - $300k/yearly
Role description
Role Overview
Crusoe is a vertically integrated AI infrastructure company building the future of AI workloads. The Senior Staff Applied AI Inference Engineer will own the inference stack end to end, profiling and optimizing large language models for high throughput and low latency inference.
What You Will Do
The role involves making large language models run faster, cheaper, and more reliably in production, working directly with customer engineering teams to tailor deployments to their needs, and taking workloads from proof of concept to fully monitored production services.
Why It Might Be a Fit
The ideal candidate will have hands-on experience shipping code in production, familiarity with modern LLM serving frameworks, and a strong grasp of how GPUs are built and behave. They will also have strong communication skills and a working knowledge of AI/ML pipelines.
Requirements
- Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or a related field
- Hands-on experience shipping code in production with one or more general-purpose languages
- Familiarity with methods for optimizing LLMs for high throughput / low latency inference
- Comfort with modern LLM serving frameworks such as vLLM or SGLang
- A firm grasp of how GPUs are built and how they behave
- Clear interest and hands-on experience with large language models
- A working knowledge of AI/ML pipelines and the full path of developing and deploying ML models
- Strong communication skills, particularly when explaining hard technical topics to customers and teammates
Benefits
- Competitive compensation and equity packages
- Restricted Stock Units
- Paid time off, paid holidays & leave of absence programs
- Comprehensive health, dental & vision insurance
- Employer contributions to HSA account
- Paid parental leave
- Paid life insurance, short-term and long-term disability
- Professional development & tuition reimbursement
- Mental health & wellness support
- Commuter benefits (parking & transit)
- Cell phone stipend
- 401(k) Retirement plan with company match up to 4% of salary
- Volunteer time off
- Global travel insurance & emergency assistance
- Daily meals allowance
- Additional perks & programs specific to location