attention head AI jobs Alerts Saved
Jobs › Gimlet Labs

Member of Technical Staff - Compiler Engineer

Gimlet Labs · San Francisco, CA
Apply on Gimlet Labs' site
Tailor my resume
Posted
Mar 10, 2026
Last verified
2 h ago
Salary
$180K – $400K / year
Employment
FullTime
Level
Staff+
Function
AI/ML Engineering
AI rolePythonCUDATritonC++Distributed SystemsLLMsGPU

16% above the median for staff and principal AI/ML Engineering roles in the United States · median $251K a year, from 706 roles that state pay

Open 8 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.

About us

Gimlet is building the first multi-silicon neocloud designed for fast, efficient AI inference.

We combine large-scale compute infrastructure with an execution platform that partitions AI workloads and maps each stage to the hardware best suited to run it.

We work with foundation labs, hyperscalers, and AI-native companies, giving our team access to technical problems spanning frontier models, production infrastructure, and emerging hardware.

About the role

As a Member of Technical Staff, Compiler, you will build Gimlet's AI Compiler Stack: the layer that determines how AI workloads are represented, optimized, and executed across hardware with fundamentally different architectures, memory systems, and performance characteristics.

The compiler is one of the hardest and most critical parts of our inference stack. Its decisions reach directly into scheduling, communication, memory movement, kernel execution, and end-to-end serving performance of Gimlet’s inference stack. A compiler built for a single target can bake in assumptions about the memory hierarchy and execution model. We can't. That constraint is what makes the work interesting.

Our stack is built on open-source MLIR and LLVM compiler infrastructure. We design our own dialects, passes, and lowering paths on top of that infrastructure rather than maintaining a proprietary compiler from scratch. You will be working in an ecosystem you can carry with you, alongside people who know it deeply.

What you will work on:

Who you will work with

This is a small team where the boundaries between disciplines are thin. You will be part of the compiler team and will work directly with engineers and researchers working on LLM architecture, inference optimization, kernel engineering, distributed systems, and datacenter infrastructure deciding what gets served and on what hardware. Compiler decisions here are made with full visibility into the workload and the machine, which is rarer than it sounds.

What success looks like

In your first 12–18 months, you will:

You may be a good fit if you have

Strong candidates may also have

Why join now?

Gimlet is expanding from its core technology into a production neocloud spanning new hardware, customers, and data centers.

Agency Policy: Gimlet Labs does not accept unsolicited resumes from recruitment agencies or search firms. Any unsolicited resumes submitted without a signed agreement will be considered the property of Gimlet Labs, and no fees will be paid.

Apply on Gimlet Labs' site

Attention Head lists this role as published on Gimlet Labs' own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All staff and principal AI/ML Engineering roles in the United States →

More roles at Gimlet Labs

All roles at Gimlet Labs →