Member of Technical Staff, Cloud Orchestration
19% above the median for staff and principal AI/ML Engineering roles in the United States · median $251K a year, from 706 roles that state pay
Open 9 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
ABOUT THE ROLE
We're looking for an cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design the systems for cluster management, deployment automation, and production monitoring that enable teams worldwide to serve AI models without friction. You'll ensure that vLLM deployments are observable, debuggable, and recoverable, turning operational complexity into infrastructure that just works.
SKILLS AND QUALIFICATIONS
Minimum qualifications:
- Bachelor's degree or equivalent experience in computer science, engineering, or similar.
- Strong experience with Kubernetes and container orchestration at scale.
- Experience designing and implementing custom Kubernetes operators.
- Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm, etc).
- Experience managing GPU clusters and debugging hardware issues.
- Ability to work across cloud platforms (AWS, GCP, Azure) and on-premise infrastructure.
Preferred qualifications:
- Experience with ML-specific orchestration tools (Ray, Slurm).
- Knowledge of GPU scheduling, multi-tenancy, and resource optimization.
- Familiarity with vLLM deployment patterns and configuration.
- Track record of improving operational reliability for ML systems.
Bonus points if you have:
- Experience deploying inference systems on large-scale GPU (1,000+) clusters.
LOGISTICS
- Location: This role is based in San Francisco, California. Will consider remote in the US for exceptional candidates.
- Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.
- Visa sponsorship: We sponsor visas on a case-by-case basis.
- Benefits: Inferact offers generous health, dental, and vision benefits as well as 401(k) company match.
Inferact, Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1TWSDK2aZycxydMvPle230QSwuQtuNIyM/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1WxUM6hcXhb3CuJ_nWgnMmHF99XsuT9sI/view?usp=sharing.
Attention Head lists this role as published on Inferact's own job board. Applications go to the employer.
Similar roles at other employers
- Sr. Staff Forward Deployed EngineerDatabricks · Remote - Washington D.C.; Washington, D.C.Nov 21, 2026
- Staff Applied AI EngineerBILL · United States$209K–250K
- Staff AI Agent Engineer – Moveworks | Partner SuccessServiceNow · New York, New York, United States$167K–291K
- Principal AI EngineerGallatin · El Segundo, CA; Washington, D.C.; Austin, TX; San Francisco, CA$240K–310K
- Member of Technical Staff, Core InfrastructureParallel Web Systems · San Francisco; New York, New York; Palo Alto$150K–300K
All staff and principal AI/ML Engineering roles in the United States →
More roles at Inferact
- Member of Technical Staff, Product SecuritySan FranciscoNov 5, 2026
- Member of Technical Staff, Vulnerability ManagementSan FranciscoOct 2, 2026
- Member of Technical Staff, Forward Deployed EngineerSan FranciscoOct 2, 2026
- Sep 24, 2026
- Sep 22, 2026
- Inference Engineering, Co-opSan FranciscoSep 15, 2026
- Sep 4, 2026
- Aug 25, 2026