attention head AI jobs Alerts Saved
Jobs › Cerebras

Engineering Manager, Inference Router

Cerebras · Sunnyvale, CA; Toronto, CAN
Apply on Cerebras' site
Tailor my resume
Posted
Oct 13, 2026
Last verified
4 min ago
Employment
FullTime
Level
Manager
Function
Software Engineering
AI roleRemoteC++KubernetesDistributed SystemsLLMsGPU

Not mentioned in the posting. Cerebras filed 59 H-1B, H-1B1 or E-3 applications in FY2025–FY2026, 36 for workers changing employer. Its US visa filings

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.

This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking real-time iteration and increasing intelligence via additional agentic computation.

Cerebras works with the leading model labs, global enterprises, and cutting-edge AI-native startups. OpenAI recently announced a multi-year partnership https://openai.com/index/cerebras-partnership/ with Cerebras, to deploy 750 megawatts of scale, transforming key workloads with ultra high-speed inference.

ABOUT THE ROLE

The Inference Router team at Cerebras builds the systems that decide where every inference request runs. We route traffic across all of Cerebras’ data centers and third-party integrations, balancing heterogeneous compute, maximizing cache utilization, and delivering the industry’s lowest time-to-first-token (TTFT) at massive scale.

As an Engineering Manager, Inference Router, you will lead the team responsible for the intelligent control plane of the fastest generative AI inference platform in the world. Your team owns global request routing, prefill/decode (P/D) disaggregation, prefix-aware routing for high cache hit rates, autoscaling, and the high-availability infrastructure that keeps the platform fast and reliable under real-time, bursty load.

This role operates at the intersection of distributed systems, Kubernetes-based infrastructure, routing-algorithm design, and machine learning. It combines technical leadership, people management, and execution ownership, with direct impact on the latency, throughput, and reliability experienced by every Cerebras inference customer.

WHAT YOU’LL DO

TECHNICAL LEADERSHIP

TEAM LEADERSHIP

EXECUTION & DELIVERY

PLATFORM & PERFORMANCE OWNERSHIP

CROSS-FUNCTIONAL COLLABORATION

WHAT YOU BRING

PREFERRED SKILLS

WHY THIS ROLE MATTERS

The Inference Router is the control plane behind Cerebras’ core promise: the fastest AI inference in the world. The routing decisions your team makes — across data centers, across heterogeneous compute, with cache-awareness and high availability — directly determine the latency, throughput, and reliability every customer experiences. Your work keeps real-time AI applications fast and dependable, and unlocks new capabilities across enterprise and frontier AI use cases.

Why Join Cerebras

People who are serious about software make their own hardware. At Cerebras, we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:

1. Build a breakthrough AI platform beyond the constraints of the GPU.

2. Publish and open source their cutting-edge AI research.

3. Work on one of the fastest AI supercomputers in the world.

4. Enjoy job stability with startup vitality.

5. Our simple, non-corporate work culture that respects individual beliefs.

Find out more about what it's like to work at Cerebras here https://www.cerebras.ai/join-us!

Apply today and become part of the forefront of groundbreaking advancements in AI!

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third-party tools process personal data. For more details, click here https://www.cerebras.net/privacy/ to review our CCPA disclosure notice.

Apply on Cerebras' site

Attention Head lists this role as published on Cerebras' own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All manager Software Engineering roles in the United States →

More roles at Cerebras

All roles at Cerebras →