Sr. Software Engineer, Inference

Role description

Role Overview

Senior engineers lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services. You’ll partner with product, orchestration, and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale.

What You Will Do

Lead design reviews, drive architecture, decompose multi-service work, define and own SLIs/SLOs, implement advanced optimizations, strengthen incident posture, mentor engineers, and own an area spanning multiple services.

Why It Might Be a Fit

You will help shape an industry-defining inference platform that enables teams to deploy generative AI and real-time applications at scale. If optimizing tail latency and delivering reliable model serving excites you, this is the place to build.

Requirements

• IC3: ~3–5 years; IC4: ~5–8 years industry experience building distributed systems or cloud services
• Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance
• Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry)
• Practical knowledge of inference internals: batching, caching, mixed precision (BF16/FP8), streaming token delivery
• Proven track record improving tail latency (P95/P99) and service reliability through metrics-driven work
• Bachelor’s or Master’s in Computer Science or related field (or equivalent practical experience)

Benefits

• Family-level Medical Insurance
• Family-level Dental Insurance
• Generous Pension Contribution
• Life Assurance at 4x Salary
• Critical Illness Cover
• Employee Assistance Programme
• Tuition Reimbursement