Member of Technical Staff, Inference & RL Systems
64% above the median for staff and principal AI/ML Engineering roles in the United States · median $251K a year, from 706 roles that state pay
Open 8 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.
Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pretraining, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.
ABOUT THE ROLE
As a Research Engineer on the Inference & RL Systems team, you will design and operate the distributed systems that serve our models in production and power large-scale post-training workflows.
This role sits at the boundary between model execution and distributed infrastructure. You will work on systems that determine inference latency, throughput, stability, and the reliability of RL and post-training training loops.
Magic’s long-context models introduce demanding execution constraints: KV-cache scaling, memory pressure under long sequences, batching trade-offs, long-horizon trajectory rollouts, and sustained throughput under real-world workloads. You will own the infrastructure that makes both production inference and large-scale RL iteration fast and reliable.
WHAT YOU’LL WORK ON
- Design and scale high-performance inference serving systems
- Optimize KV-cache management, batching strategies, and scheduling
- Improve throughput and latency for long-context workloads
- Build and maintain distributed RL and post-training infrastructure
- Improve reliability of rollout, evaluation, and reward pipelines
- Automate fault detection and recovery for serving and RL systems
- Profile and eliminate performance bottlenecks across GPU, networking, and storage layers
- Collaborate with Kernels and Research to align execution systems with model architecture
WHAT WE’RE LOOKING FOR
- Strong software engineering and distributed systems fundamentals
- Experience building or operating large-scale inference or training systems
- Deep understanding of GPU execution constraints and memory trade-offs
- Experience debugging performance issues in production ML systems
- Ability to reason about system-level trade-offs between latency, throughput, and cost
- Track record of owning critical production infrastructure
OUR CULTURE
- Integrity. Words and actions should be aligned
- Hands-on. At Magic, everyone is building
- Teamwork. We move as one team, not N individuals
- Focus. Safely deploy AGI. Everything else is noise
- Quality. Magic should feel like magic
Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.
COMPENSATION, BENEFITS, AND PERKS (US)
- Annual salary range: $275K - $550K
- Equity is a significant part of total compensation, in addition to salary
- 401(k) plan with 6% salary matching
- Generous health, dental and vision insurance for you and your dependents
- Unlimited paid time off
- Visa sponsorship and relocation stipend to bring you to SF, if possible
- A small, fast-paced, highly focused team
Attention Head lists this role as published on Magic's own job board. Applications go to the employer.
Similar roles at other employers
- Sr. Staff Forward Deployed EngineerDatabricks · Remote - Washington D.C.; Washington, D.C.Nov 21, 2026
- Staff Applied AI EngineerBILL · United States$209K–250K
- Staff AI Agent Engineer – Moveworks | Partner SuccessServiceNow · New York, New York, United States$167K–291K
- Principal AI EngineerGallatin · El Segundo, CA; Washington, D.C.; Austin, TX; San Francisco, CA$240K–310K
- Member of Technical Staff, Core InfrastructureParallel Web Systems · San Francisco; New York, New York; Palo Alto$150K–300K
All staff and principal AI/ML Engineering roles in the United States →
More roles at Magic
- Member of Technical Staff, EvalsSan Francisco; RemoteNov 11, 2026
- Member of Technical Staff, Security EngineerSan FranciscoAug 7, 2026
- Member of Technical Staff, Pretraining SystemsSan FranciscoFeb 28, 2026
- Nov 8, 2024
- <insert-job-you-excel-at/San FranciscoFeb 14, 2024
- Research EngineerSan FranciscoJan 24, 2024
- Member of Technical Staff, KernelsSan Francisco; RemoteJan 24, 2024