Staff Applied AI Inference Engineer
Crusoe — San Francisco, California, United States · In-Person · Staff+ · $215k - $260k/yearly
Role description
Role Overview
Join Crusoe, a vertically integrated AI infrastructure company, to accelerate the abundance of energy and intelligence. As a Staff Applied AI Inference Engineer, you will spend your time making large language models run faster, cheaper, and more reliably in production.
What You Will Do
You will own the inference stack end to end, profiling where time and cost go, bringing modern optimization techniques into real deployments, and getting deep into the serving code when the defaults are not good enough.
Why It Might Be a Fit
This is a hands-on engineering role built around coding, profiling, and low-level optimization, with a customer-facing side, and elements of product and technical solutions work.
Requirements
- Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or a related field
- Hands-on experience shipping code in production with one or more general-purpose languages, such as Python or C++
- Familiarity with methods for optimizing LLMs for high throughput / low latency inference
- Comfort with modern LLM serving frameworks such as vLLM or SGLang, and with profiling and analyzing performance down to the kernel level
- A firm grasp of how GPUs are built and how they behave
- Clear interest and hands-on experience with large language models
- A working knowledge of AI/ML pipelines and the full path of developing and deploying ML models
- Strong communication skills, particularly when explaining hard technical topics to customers and teammates
Benefits
- Competitive compensation
- Equity packages
- Restricted Stock Units
- Paid time off, paid holidays & leave of absence programs
- Comprehensive health, dental & vision insurance
- Employer contributions to HSA account
- Paid parental leave
- Paid life insurance, short-term and long-term disability
- Professional development & tuition reimbursement
- Mental health & wellness support
- Commuter benefits (parking & transit)
- Cell phone stipend
- 401(k) Retirement plan with company match up to 4% of salary
- Volunteer time off
- Global travel insurance & emergency assistance
- Daily meals allowance
- Additional perks & programs specific to location