attention head AI jobs Alerts Saved
Jobs › NVIDIA

Senior System Software Engineer - Local AI

NVIDIA · India, Pune
Apply on NVIDIA's site
Tailor my resume
Posted
Sep 28, 2026
Last verified
15 min ago
Level
Senior
Function
Software Engineering
AI rolePyTorchCUDAC++LLMsGPU

NVIDIA has continuously reinvented itself for more than two decades. The invention of the GPU in 1999 fueled the growth of the PC gaming market, redefined modern computer graphics, and revolutionized parallel computing. GPU-powered deep learning helped ignite the era of modern AI, establishing GPUs as the foundation of intelligent applications across productivity, gaming, and creative workflows, and reinforcing NVIDIA's position as a leading AI computing company.
More recently, there is a growing focus on running AI models locally, closer to where data is generated. This approach reduces latency, enables real-time processing, and addresses privacy concerns by minimizing the need to send data to centralized servers. As technology continues to evolve, client-side AI will play an increasingly important role in shaping the digital landscape. The LocalAI team is seeking a Senior Systems Software Engineer to lead the architecture of efficient on-device AI software for RTX and DGX-class systems. The role focuses on delivering high-performance local inference with low latency, optimized memory utilization, robust infrastructure, and practical deployment on resource-constrained platforms

What You'll Be Doing:

What we need to see:

Ways to stand out from the crowd:

We're a top employer recognized for innovation, growth, and commitment to diversity as an equal opportunity workplace. We offer competitive salaries, a generous benefits package, and the opportunity to work alongside some of the industry's most talented and forward-thinking professionals. As our engineering teams continue to grow rapidly, we're looking for creative, self-driven engineers with a passion for technology to join us.

Apply on NVIDIA's site

Attention Head lists this role as published on NVIDIA's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Software Engineering roles in India →

More roles at NVIDIA

All roles at NVIDIA →