attention head AI jobs Alerts Saved
Jobs › LiteLLM

Staff Backend Engineer

LiteLLM · San Francisco
Apply on LiteLLM's site
Tailor my resume
Posted
Nov 20, 2026
Last verified
9 h ago
Salary
$250K – $350K / year
Employment
FullTime
Level
Staff+
Function
Software Engineering
PythonRustGoC++Distributed SystemsLLMs

20% above the median for staff and principal Software Engineering roles in the United States · median $250K a year, from 805 roles that state pay

Staff Backend Engineer

LiteLLM is the world’s most popular open-source AI Gateway, used by Adobe, Netflix, NASA, NVIDIA and much of the Fortune 500. Every LLM call these companies make runs through our code, so when we break, they break. We’re a team of about 20, and we’re hiring senior and staff backend engineers to own the core of the gateway and keep it fast and reliable as traffic grows.

About the role

You’ll own critical parts of the LiteLLM proxy: routing, auth, caching, spend tracking, guardrails and observability. The job is to make these systems correct, fast and dependable at 1B+ requests a month. That means hunting down silent failures, fixing the root cause in code rather than adding another dashboard, and refactoring components that keep breaking without changing how they behave. You’ll set the bar for how our mostly early-career team writes, tests and ships backend code.

What you’ll do

What we’re looking for

Nice to have

Why LiteLLM

About LiteLLM

LiteLLM https://github.com/BerriAI/litellm is a Python SDK and proxy server for calling 100+ LLM APIs in the OpenAI format, with 60K+ GitHub stars.

Apply on LiteLLM's site

Attention Head lists this role as published on LiteLLM's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All staff and principal Software Engineering roles in the United States →

More roles at LiteLLM

All roles at LiteLLM →