attention head AI jobs Alerts Saved
Jobs › Kog

GPU Engineer

Kog · Paris, France
Apply on Kog's site
Tailor my resume
Posted
Nov 9, 2026
Last verified
3 h ago
Employment
FullTime
Level
Mid
Function
AI/ML Engineering
AI roleRemoteCUDAC++LLMsGPU

ABOUT KOG

At Kog, we're building real-time LLM inference for AI agents.

Coding agents execute sequences of tasks where each step depends on the model's previous response. The faster the model generates tokens, the faster these agents can reason, code, and act.

Our approach is to co-design model architecture, the inference engine, and low-level GPU kernels to minimize generation latency on standard NVIDIA and AMD datacenter GPUs.

We've developed several technologies to make this possible:

Our engineers work directly with GPU hardware, using CUDA, PTX, HIP, and CDNA ISA to optimize execution.

Implementing and optimizing a new AI model for a specific GPU architecture can take months of manual engineering. Meanwhile, new models are constantly being released.

Our goal is to use AI agents to implement and optimize the models we choose on the GPUs we choose, in a fraction of the time required today.

These agents will build on the GPU optimizations and hardware insights our team has developed. They'll explore optimization strategies, generate and modify kernels, verify correctness, benchmark performance on real hardware, and iterate based on the results.

We want to make model porting and GPU optimization much faster and repeatable, allowing Kog to keep pace with the latest AI models rather than spending months adapting each one manually.

This is a major engineering direction we're now developing, and you'll help shape it.

Learn more at https://blog.kog.ai.

WHAT YOU'LL WORK ON

You'll join our GPU engineering team to tackle challenging performance problems and help build the internal agents that will accelerate this work.

WHAT WE'RE LOOKING FOR

We're looking for an experienced GPU Engineer who can contribute quickly and independently to complex performance problems.

Experience with PTX, CDNA ISA, multi-GPU systems, low-latency inference, or GPU performance portability is particularly valuable.

A PhD in HPC, computer science, or a related field is a plus when backed by substantial engineering work. Previous experience building AI agents is not required.

LOCATION AND AVAILABILITY

Candidates must already be based in Paris or elsewhere in Île-de-France.

We are not considering relocation from other regions or countries for this position.

We're looking for someone who can join the team quickly.

Apply on Kog's site

Attention Head lists this role as published on Kog's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All mid-level AI/ML Engineering roles in France →