attention head AI jobs Alerts Saved
Jobs › Together AI

Senior Backend Engineer, Inference Platform

Together AI · San Francisco
Apply on Together AI's site
Tailor my resume
Posted
Aug 22, 2025
Last verified
29 min ago
Salary
$200K – $290K / year
Level
Senior
Function
Software Engineering
AI rolePythonCUDATritonRustGoTypeScriptKubernetesDistributed SystemsLLMsRLGPU

23% above the median for senior Software Engineering roles in the United States · median $200K a year, from 1,264 roles that state pay

Open 14 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.

Not mentioned in the posting. Together AI filed 22 H-1B, H-1B1 or E-3 applications for AI roles in FY2025–FY2026, 4 for workers changing employer. Its US visa filings

About the Role

Together AI is building the Inference Platform that brings the most advanced generative AI models to the world. Our platform powers multi-tenant serverless workloads and dedicated endpoints, enabling developers, enterprises, and researchers to harness the latest LLMs, multimodal models, image, audio, video, and speech models at scale.

If you get a thrill from optimizing latency down to the last millisecond, this is your playground. You’ll work hands-on with tens of thousands of GPUs (H100s, H200s, GB200s, and beyond), figuring out how to fully utilize every FLOP and every gigabyte of memory.

You’ll collaborate directly with research teams to bring frontier models into production, making breakthroughs usable in the real world. Our team also works closely with the open source community, contributing to and leveraging projects like SGLang, vLLM, and NVIDIA Dynamo to push the boundaries of inference performance and efficiency.

Responsibilities

Requirements

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $200,000 - $290,000 + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Application Policy

Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy

Apply on Together AI's site

Attention Head lists this role as published on Together AI's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Software Engineering roles in the United States →

More roles at Together AI

All roles at Together AI →