Senior Applied Scientist, Efficient LLM Inference & Model Optimization

Nebius — Palo Alto, California, United States · In-Person · Senior · $195k - $262k/yearly

Apply for this role

Role description

Role Overview

Nebius is a leading cloud infrastructure provider for the global AI economy. As a Senior Applied Scientist, you will own well-scoped research and production optimization projects, design rigorous experiments, write strong code, and collaborate with engineers to convert research into deployed inference capabilities.

What You Will Do

Your responsibilities will include owning focused research projects, preparing internal reports and technical blogs, partnering with MLEs to ensure research prototypes become usable production components, and inventing, evaluating, and productionizing methods for efficient LLM and VLM inference.

Why It Might Be a Fit

You will have the opportunity to work on impactful AI projects, collaborate with talented teams, and shape the future of AI. You will also have access to competitive compensation, career growth, and learning opportunities, as well as a collaborative and innovative culture.

Requirements

  • PhD in computer science, machine learning, ML systems, computer systems, computer architecture, electrical engineering, applied math, or a closely related field
  • Strong publication record or equivalent research artifacts in ML, ML systems, efficient inference, model compression, quantization, distillation, serving systems, or related areas
  • Strong hands-on coding ability in Python and PyTorch
  • Deep understanding of LLMs, VLMs, transformer inference, decoding algorithms, model compression, quantization, and production-serving tradeoffs
  • Strong experimental design skills, including ablations, baselines, metrics, statistical reasoning, and failure analysis

Benefits

  • 100% company-paid medical, dental, and vision coverage for employees and families
  • 401(k) plan with up to 4% company match with immediate vesting
  • 20 weeks paid parental leave for primary caregivers, 12 weeks for secondary caregivers
  • Up to $85/month for mobile and internet reimbursement
  • Company-paid short-term, long-term, and life insurance coverage
  • Competitive compensation
  • Career growth and learning opportunities
  • Flexibility and ownership
  • Collaborative and innovative culture
  • Opportunity to work on impactful AI projects
  • International environment and talented teams

More jobs at Nebius

Canonical job page

More roles at Nebius