Member of Technical Staff, Kernels
64% above the median for staff and principal AI/ML Engineering roles in the United States · median $251K a year, from 706 roles that state pay
Open 2 years. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pretraining, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.
ABOUT THE ROLE
As a Kernel Engineer, you will design, implement, and maintain high-performance kernels to optimize throughput and latency during training and inference.
Magic's long-context windows create distinct kernel optimization challenges around memory utilization, data movement, and sustained throughput.
WHAT YOU'LL WORK ON
- Design and implement kernels that support high-performance long-context behavior
- Ownership of kernel design, implementation, deployment, and production reliability
- Focus on robustness, extensive testing, and functional correctness, while pushing on performance
- Evaluate porting Magic’s compute kernels to alternative hardware options
- Co-design kernels with understanding and interaction with training, inference, and RL teams
- For a sample of our work, see Magic-Attention, presented at GTC 2026 https://www.nvidia.com/gtc/session-catalog/sessions/gtc26-s82294/
WHAT WE’RE LOOKING FOR
- Low-level programming experience targeting AI accelerators such as NVIDIA Blackwell or Google TPUs
- Develop and optimize GPU kernels in frameworks such as NCCL https://developer.nvidia.com/nccl, MSCCLPP https://github.com/microsoft/mscclpp, CUTLASS https://github.com/NVIDIA/cutlass, CuTeDSL https://docs.nvidia.com/cutlass/latest/media/docs/pythonDSL/cute_dsl.html, Triton https://github.com/triton-lang/triton, Quack https://github.com/Dao-AILab/quack, Flash-Attention https://github.com/Dao-AILab/flash-attention, and similar frameworks
- Experience in other kernel authoring frameworks such as Pallas https://docs.jax.dev/en/latest/pallas/index.html/Mosaic (GPU https://docs.jax.dev/en/latest/pallas/gpu/index.html or TPU https://docs.jax.dev/en/latest/pallas/gpu/index.html), or Mojo https://www.modular.com/blog/matrix-multiplication-on-nvidias-blackwell-part-1-introduction also maps well to the work on Magic's kernel team
- Strong depth over shallow breadth: for kernel engineering, we prefer candidates with deep expertise in computer architecture, low-level machine optimizations, and code generation, with breadth across ML
- Agility, ownership mindset, and grit
OUR CULTURE
- Integrity. Words and actions should be aligned
- Hands-on. At Magic, everyone is building
- Teamwork. We move as one team, not N individuals
- Focus. Safely deploy AGI. Everything else is noise
- Quality. Magic should feel like magic
Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.
COMPENSATION, BENEFITS AND PERKS (US)
- Annual salary ranges between $275K - $550K based on experience
- Equity is a significant part of total compensation, in addition to salary
- 401(k) plan with 6% salary matching
- Generous health, dental and vision insurance for you and your dependents
- Unlimited paid time off
- Visa sponsorship and relocation stipend to bring you to SF, if possible
- A small, fast-paced, highly focused team
Attention Head lists this role as published on Magic's own job board. Applications go to the employer.
Similar roles at other employers
- Sr. Staff Forward Deployed EngineerDatabricks · Remote - Washington D.C.; Washington, D.C.Nov 21, 2026
- Staff Applied AI EngineerBILL · United States$209K–250K
- Staff AI Agent Engineer – Moveworks | Partner SuccessServiceNow · New York, New York, United States$167K–291K
- Principal AI EngineerGallatin · El Segundo, CA; Washington, D.C.; Austin, TX; San Francisco, CA$240K–310K
- Member of Technical Staff, Core InfrastructureParallel Web Systems · San Francisco; New York, New York; Palo Alto$150K–300K
All staff and principal AI/ML Engineering roles in the United States →
More roles at Magic
- Member of Technical Staff, EvalsSan Francisco; RemoteNov 11, 2026
- Member of Technical Staff, Security EngineerSan FranciscoAug 7, 2026
- Member of Technical Staff, Pretraining SystemsSan FranciscoFeb 28, 2026
- Member of Technical Staff, Inference & RL SystemsSan FranciscoFeb 28, 2026
- Nov 8, 2024
- <insert-job-you-excel-at/San FranciscoFeb 14, 2024
- Research EngineerSan FranciscoJan 24, 2024