attention head AI jobs Alerts Saved
Jobs › Magic

Member of Technical Staff, Evals

Magic · San Francisco; Remote
Apply on Magic's site
Tailor my resume
Posted
Nov 11, 2026
Last verified
2 h ago
Salary
$225K – $550K / year
Employment
FullTime
Level
Staff+
Function
AI/ML Engineering
AI roleRemoteVisa sponsorshipEvals

54% above the median for staff and principal AI/ML Engineering roles in the United States · median $251K a year, from 706 roles that state pay

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pretraining, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

ABOUT THE ROLE

The Evals team measures the performance and capabilities of internal and external models, helping teams across Magic make informed decisions. The team supports pretraining, RL, data, inference, and product, and sits on the critical path of many of the company's most important decisions.

As a Member of Technical Staff on Evals, you will develop new benchmarks and evaluation methodologies, run data ablations, assess dataset quality, and investigate whether our measurements accurately reflect model performance.

Sweating the details matters on this team. Many benchmarks, papers, and open-source evaluation frameworks contain subtle bugs or flawed assumptions that lead to misleading conclusions. We care deeply about correctness, reproducibility, and measurement quality.

WHAT YOU'LL WORK ON

WHAT WE'RE LOOKING FOR

OUR CULTURE

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.

COMPENSATION, BENEFITS, AND PERKS (US)

Apply on Magic's site

Attention Head lists this role as published on Magic's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All staff and principal AI/ML Engineering roles in the United States →

More roles at Magic

All roles at Magic →