attention head AI jobs Alerts Saved
Jobs › LiteLLM

Staff Engineer, Systems and Reliability

LiteLLM · San Francisco
Apply on LiteLLM's site
Tailor my resume
Posted
Nov 9, 2026
Last verified
7 h ago
Salary
$250K – $350K / year
Employment
FullTime
Level
Staff+
Function
Software Engineering
PythonRustLLMs

20% above the median for staff and principal Software Engineering roles in the United States · median $250K a year, from 805 roles that state pay

LiteLLM is the world’s most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We’ve grown ARR 6x in the last year to nearly $30M with a team of 20, and thousands of companies run production AI through LiteLLM across 100+ provider integrations.

We're looking for a Staff Engineer to own the stability and reliability of the gateway.

ABOUT THE ROLE

This is a hands-on staff role. You'll find the components behind our regressions and security issues, and refactor or rewrite them so the same problem doesn't come back in 20 places. You'll raise the quality of the codebase through your own code and review, not process documents.

LiteLLM is mission-critical infrastructure for our customers. When it breaks, their AI products break. You'll make sure that happens less, and that we know before they do.

You’ll work with our security and infrastructure team and report to the CEO, and later to our Head of Engineering. This role is in person in San Francisco. We help with relocation and support H-1B transfers.

RESPONSIBILITIES

What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres. We're moving the gateway to Rust.

WHAT WE'RE LOOKING FOR

BONUS POINTS

WHY JOIN LITELLM?

ABOUT LITELLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you want to own the reliability of the gateway thousands of companies depend on, we'd love to meet you.

Apply on LiteLLM's site

Attention Head lists this role as published on LiteLLM's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All staff and principal Software Engineering roles in the United States →

More roles at LiteLLM

All roles at LiteLLM →