attention head AI jobs Alerts Saved
AI jobs › AI jobs using Evals

AI jobs using Evals

Evals are the tests of AI: benchmarks and custom test sets, graders (people or other models), and the harnesses that run them. Labs use them to track capabilities and safety through training; product teams use them to decide whether a new prompt, model or retrieval setup is actually better.

Roles naming them include research on capability and safety evaluations, engineering for evaluation infrastructure, and applied AI work. We count postings that say evals, or evaluation of models, LLMs or AI (model evaluation, evaluation harnesses and pipelines, evaluating LLMs), not evaluation in a general sense.

3,965 open AI roles at 1,626 employers, from their own job boards. Showing the newest 100.

Amazon · 119Anthropic · 64OpenAI · 61NVIDIA · 49Mercor · 35Microsoft · 31Innodata Inc. · 30Scale AI · 26Waymo · 26Bosch Group · 25ServiceNow · 25Libra Technology GmbH · 21Aptura · 20NewRocket · 20Workday, Inc. · 19

Related