attention head AI jobs Alerts Saved
Jobs › Inferact

Member of Technical Staff, AMD GPU Kernel Engineering

Inferact · San Francisco
Apply on Inferact's site
Tailor my resume
Posted
Jun 26, 2026
Last verified
7 h ago
Salary
$200K – $400K / year
Employment
FullTime
Level
Staff+
Function
AI/ML Engineering
AI roleVisa sponsorshipPyTorchJAXCUDATritonLLMsGPU

19% above the median for staff and principal AI/ML Engineering roles in the United States · median $251K a year, from 706 roles that state pay

Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware, a position that took years to build.

About the Role

We're looking for an AMD GPU kernel engineer to make vLLM a first-class inference engine across the AMD accelerator ecosystem. A large part of this role is designing, writing, and optimizing kernels for AMD GPUs in HIP, Triton, CK, and AITER, for attention, GEMM, sampling, KV cache, and communication-heavy operations.

You'll work at the boundary of kernels, compilers, inference systems, and hardware architecture. You'll profile production-relevant models on AMD GPUs, find the bottleneck, and write the kernel that removes it, with clear correctness, latency, and throughput benchmarks. Your work will help make AMD GPU support in vLLM usable, fast, benchmarked, and maintainable.

Inferact has three kernel roles. If your kernel work is mostly on Google TPUs (Pallas, JAX), apply to TPU Kernel Engineering. If it is mostly on AMD GPUs (HIP, CK, AITER), apply to AMD GPU Kernel Engineering. For NVIDIA GPUs and cross-platform kernel work, apply to Kernel Engineering. Apply to one; we route you to the best fit.

Skills and Qualifications

Minimum qualifications:

Preferred qualifications:

Bonus points if you have:

Representative projects

Logistics

Inferact, Inc. is an E-Verify company, and you may review the Notice of E-Verify Participation https://drive.google.com/file/d/1TWSDK2aZycxydMvPle230QSwuQtuNIyM/view?usp=sharing and the Right to Work posters in English and Spanish https://drive.google.com/file/d/1WxUM6hcXhb3CuJ_nWgnMmHF99XsuT9sI/view?usp=sharing.

Apply on Inferact's site

Attention Head lists this role as published on Inferact's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All staff and principal AI/ML Engineering roles in the United States →

More roles at Inferact

All roles at Inferact →