attention head AI jobs Alerts Saved
Jobs › NVIDIA

Senior Performance Engineer - LLM Inference Frameworks

NVIDIA · 4 Locations
Apply on NVIDIA's site
Tailor my resume
Posted
Apr 20, 2026
Last verified
3 h ago
Level
Senior
Function
Software Engineering
AI rolePythonPyTorchLLMsGPU

Open 7 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.

NVIDIA is hiring exceptional software engineers to build and optimize the core inference infrastructure for large language models. Join the TensorRT‑LLM team - the group defining how generative AI performs at global scale on NVIDIA GPUs. We’re looking for engineers who love squeezing every drop of throughput, memory efficiency, and scalability out of modern model runtimes. Your work will directly shape the frameworks behind state‑of‑the‑art LLM inference used across NVIDIA and the AI community. Join us to redefine what “fast” means for LLM inference - building the frameworks that power the next generation of generative AI at scale.

What you'll be doing:

What we need to see:

Ways to stand out from the crowd:

Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com.

#LI-Hybrid

Apply on NVIDIA's site

Attention Head lists this role as published on NVIDIA's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Software Engineering roles →

More roles at NVIDIA

All roles at NVIDIA →