attention head AI jobs Alerts Saved
Jobs › LiteLLM

ML Engineer

LiteLLM · San Francisco
Apply on LiteLLM's site
Tailor my resume
Posted
Nov 11, 2026
Last verified
9 h ago
Salary
$200K – $250K / year
Employment
FullTime
Level
Mid
Function
AI/ML Engineering
AI rolePythonLLMs

12% above the median for mid-level AI/ML Engineering roles in the United States · median $200K a year, from 686 roles that state pay

LiteLLM is the world's most popular AI Gateway, trusted by companies like Adobe, Netflix, and NASA. We're building the next generation of infrastructure for AI applications—and now we're building our second product.

WHAT YOU WILL BE WORKING ON

Skills: Python, LLM APIs, FastAPI

As the ML Engineer, you'll be responsible for ensuring LiteLLM unifies the format for calling LLM APIs in the broader OpenAI + Anthropic spec. This involves writing transformations to convert API requests from OpenAI/Anthropic spec to various LLM provider formats, building provider-agnostic unification functionality (e.g. session management across non-openai models for /v1/responses API, etc.). You'll work directly with the CEO and CTO on critical projects including:

What is our tech stack

The tech stack includes Python, FastAPI, Redis, Postgres.

WHO WE ARE LOOKING FOR

WHY JOIN LITELLM?

ABOUT LITELLM

LiteLLM is the world's most widely adopted AI Gateway. We provide a unified API for 100+ LLM providers along with routing, authentication, budgets, observability, and governance for production AI systems. Thousands of companies rely on LiteLLM to power AI in production.

If you love talking to users, building products, and shipping software that people actually use, we'd love to meet you.

Apply on LiteLLM's site

Attention Head lists this role as published on LiteLLM's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All mid-level AI/ML Engineering roles in the United States →

More roles at LiteLLM

All roles at LiteLLM →