attention head AI jobs Alerts Saved
Jobs › NVIDIA

Senior Software Engineer, LLM Inference

NVIDIA · Israel, Tel Aviv
Apply on NVIDIA's site
Tailor my resume
Posted
Jul 21, 2026
Last verified
2 h ago
Level
Senior
Function
Software Engineering
AI rolePyTorchCUDATritonLLMsGPU

NVIDIA has been at the forefront of the deep learning revolution, pioneering innovations that have transformed the entire field. As the leading provider of GPUs and AI computing platforms, NVIDIA has empowered researchers and engineers worldwide to accelerate breakthroughs in artificial intelligence.

We seek a versatile Senior Software Engineer who is passionate about performance optimization and generative AI. Our team brings the latest research in LLM inference — from novel decoding strategies to quantization schemes — into production across NVIDIA's hardware lineup, from large data center servers to powerful edge devices. We work on the most advanced architectures in the field, with a focus on NVIDIA's own.

What you'll be doing:

What we need to see:

Ways to stand out from the crowd:

NVIDIA is widely considered one of the world's most desirable employers in the technology field. We have some of the most forward-thinking and hardworking people working for us. If you're creative and autonomous, we want to hear from you! We are committed to fostering a diverse work environment and are proud to be an equal-opportunity employer. We highly value diversity in our current and future employees. We do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status, or any other characteristic protected by law.

Apply on NVIDIA's site

Attention Head lists this role as published on NVIDIA's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Software Engineering roles in Israel →

More roles at NVIDIA

All roles at NVIDIA →