attention head AI jobs Alerts Saved
Jobs › Together AI

Senior Product Manager, Inference

Together AI · San Francisco
Apply on Together AI's site
Tailor my resume
Posted
Aug 17, 2026
Last verified
9 h ago
Salary
$250K – $300K / year
Level
Senior
Function
Product
AI roleDistributed SystemsLLMsRLGPU

42% above the median for senior Product roles in the United States · median $194K a year, from 244 roles that state pay

Not mentioned in the posting. Together AI filed 22 H-1B, H-1B1 or E-3 applications for AI roles in FY2025–FY2026, 4 for workers changing employer. Its US visa filings

About the Role

Inference is a critical part of Together AI’s vision and growth strategy. Developers and enterprises use Together to run leading open models across coding agents, AI-native applications, enterprise workflows, and large-scale production workloads.

We’re looking for a Senior Product Manager to shape how customers consume and build on Together inference.

As inference becomes a larger part of our business, the product surface is becoming more complex. Workloads span different tenancy, capacity, performance, and modality needs; agentic applications are changing how inference is consumed; and customers increasingly expect deep infrastructure capabilities to translate into predictable, easy-to-use products.

This role owns the product layer between Together’s inference infrastructure and the developers and enterprises consuming it. You’ll help define how our portfolio of inference products fits together, where Together should differentiate, how customers move from experimentation to production, and how the developer experience evolves as workloads become more sophisticated.

This is a hands-on technical product role. You’ll use our APIs and SDKs, study real workloads, test integrations, and work closely with inference platform engineers and researchers to turn infrastructure and model capabilities into clear product decisions and customer experiences.

Responsibilities

Requirements

Experience with LLM inference, model serving, distributed systems, GPU infrastructure, agents, or developer-facing AI products is helpful, but not required. We care most about your ability to learn technical systems quickly, get close to the product, and develop strong judgment.

About Together AI

Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month.

Compensation

We offer competitive compensation, startup equity, health insurance and other competitive benefits. The US base salary range for this full-time position is: $250 - 300k + equity + benefits. Our salary ranges are determined by location, level and role. Individual compensation will be determined by experience, skills, and job-related knowledge.

Application Policy

Please read each role carefully and apply to the position best suited to you. Candidates are limited to 6 applications within a 90-day period, and applications beyond that limit will be automatically rejected. You may apply to additional roles 90 days after your last application.

Equal Opportunity

Together AI is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Please see our privacy policy at https://www.together.ai/privacy.

Apply on Together AI's site

Attention Head lists this role as published on Together AI's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Product roles in the United States →

More roles at Together AI

All roles at Together AI →