attention head AI jobs Alerts Saved
Jobs › River AI Inc.

Software Engineer, GPU Kernels

River AI Inc. · Palo Alto, CA
Apply on River AI Inc.'s site
Tailor my resume
Posted
Sep 12, 2026
Last verified
2 h ago
Salary
$200K – $420K / year
Level
Mid
Function
Software Engineering
Visa sponsorshipPythonPyTorchCUDATritonC++GPU

61% above the median for mid-level Software Engineering roles in the United States · median $193K a year, from 1,780 roles that state pay

At River AI, our mission is to create personal AI owned and shaped by each individual. To achieve this, we are rewriting the entire stack from scratch: personal hardware for local inference, bespoke training infrastructure, next-generation UIs, and frontier deep learning research.

Who we are

We are scientists, engineers, and builders from the industry's top tech companies and AI labs. We bring a proven track record of scaling consumer systems for hundreds of millions of users and architecting the pre-training infrastructure behind today's frontier models.

About the Role

We are looking for exceptional GPU kernel engineers to build the compute primitives behind River’s training and inference infrastructure. Your goal is to make large models faster to train and more efficient to serve.

You will own performance-critical operations, including attention, matrix multiplication, mixture-of-experts execution, and low-precision computation. Working closely with researchers and systems engineers, you will identify bottlenecks, implement kernels, validate correctness, and bring improvements into production.

What You’ll Do

Skills & Qualifications

Minimum Qualifications:

Preferred Qualifications: (We encourage you to apply even if you don't meet all of these)

Logistics & Benefits

Apply on River AI Inc.'s site

Attention Head lists this role as published on River AI Inc.'s own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All mid-level Software Engineering roles in the United States →

More roles at River AI Inc.

All roles at River AI Inc. →