AI jobs › AI jobs using Evals
AI jobs using Evals
Evals are the tests of AI: benchmarks and custom test sets, graders (people or other models), and the harnesses that run them. Labs use them to track capabilities and safety through training; product teams use them to decide whether a new prompt, model or retrieval setup is actually better.
Roles naming them include research on capability and safety evaluations, engineering for evaluation infrastructure, and applied AI work. We count postings that say evals, or evaluation of models, LLMs or AI (model evaluation, evaluation harnesses and pipelines, evaluating LLMs), not evaluation in a general sense.
3,965 open AI roles at 1,626 employers, from their own job boards. Showing the newest 100.
Amazon · 119Anthropic · 64OpenAI · 61NVIDIA · 49Mercor · 35Microsoft · 31Innodata Inc. · 30Scale AI · 26Waymo · 26Bosch Group · 25ServiceNow · 25Libra Technology GmbH · 21Aptura · 20NewRocket · 20Workday, Inc. · 19
- Senior AI Engineer - Enterprise Agentic SystemsRubrik Job Board · Bangalore · 5 locations3 h ago
- AI Product ManagerOpusClip · Mountain Viewup to $280K · 8 h ago
- Imminent Risk (Law Enforcement) Specialist – Violent Extremism10a Labs · PT Hours9 h ago
- Imminent Risk (Law Enforcement) Specialist – Overnight Shift10a Labs · PT Hours10 h ago
- Imminent Risk (Law Enforcement) Specialist – Day Shift10a Labs · PT Hours10 h ago
- Software Engineer II - AI EngineeringMicrosoft · Toronto, ON, CAup to CA$169K · 11 h ago
- Senior Software Engineer - AI EngineeringMicrosoft · ON,CAup to CA$204K · 11 h ago
- Research Operations, External ArtifactsAnthropic · Remote-Friendly, United Statesup to $260K · 11 h ago
- Researcher, Cyber Safety TrainingOpenAI · San Franciscoup to $500K · 11 h ago
- Senior Software Engineer, AIKlue · Toronto, Ontarioup to CA$195K · 11 h ago
- Staff Applied AI EngineerBILL · United Statesup to $250K · 12 h ago
- Base Labs Research Scientist - RL EnvironmentsBaseten · San Francisco; New York12 h ago
- Product Manager, Agentic SearchExa · San Francisco, Californiaup to $270K · 12 h ago
- MLOps / DevOps Engineer – AI InfrastructureCreatorIQ · New York; New Jersey; Los Angeles; San Franciscoup to $155K · 12 h ago
- Senior Manager, Marketing Technology & AIMonster Energy · USA - Corona, CAup to $140K · 13 h ago
- Model Safety Investigations Specialist10a Labs · Washington DC, San Francisco CA, NYC, Denver COup to $150K · 13 h ago
- Engineering Leader, Machine Learning & Ad PlatformMoxxi Digital · New York, New Yorkup to $300K · 13 h ago
- Head of Machine LearningVidea · Boston, Massachusettsup to $275K · 14 h ago
- Clinical AI Quality SpecialistHello Heart · Remote USup to $143K · 14 h ago
- Senior Software Engineer -AIUiPath · Bellevueup to $230K · 15 h ago
- Junior AI EngineerVertex Service Partners · Charlotte, NC 2821115 h ago
- Senior AI Lead (GenAI & Agentic AI)Encora · Mexico15 h ago
- Senior Machine Learning EngineerEncora · Colombia · 2 locations15 h ago
- Staff Product Manager, Agentic Ads BuyingReddit · Remote - United States · 2 locationsup to $304K · 15 h ago
- Director, AI Platform EngineeringServiceNow · West Palm Beach, Florida, United States16 h ago
- Research Intern - AI /Machine Learning Numerics & EfficiencyMicrosoft · Mountain View, CA, US; Redmond, WA, US · 2 locationsup to $13K/mo · 16 h ago
- Staff Research Engineer/Scientist - Conversational AIServiceNow · Santa Clara, California, United Statesup to $354K · 16 h ago
- AI Technical Product Manager, Dean's OfficeHarvard University · Boston, MA, United States17 h ago
- Senior Machine Learning Engineer / Applied ScientistMicrosoft · Vancouver, BC, CAup to CA$204K · 18 h ago
- Tech Product Manager - Agentic PlatformMirakl - Labs · Bordeaux, France · 2 locations18 h ago
- AI Engineer - Agent Infrastructure & AI WorkflowTribalScale · Remote USA19 h ago
- Machine Learning ScientistASOS · London, England, United Kingdom19 h ago
- Senior Director, AI DeploymentFanatics Collectibles · Los Angeles, CA, United States; New York, NY, United Statesup to $280K · 19 h ago
- Research Engineer, Beneficial DeploymentsAnthropic · San Francisco, CAup to $850K · 19 h ago
- Sr. AI Developer, EngineeringEVERSANA · Overland Park, KS, United States19 h ago
- Model Behavior EngineerOvertone · New York Cityup to $190K · 20 h ago
- Research Engineer, Computer VisionAvride · Austin, Texas20 h ago
- Senior AI Engineer Freelance - ProductMirakl - Labs · Bordeaux, France · 2 locations20 h ago
- Lead Cyber AI EngineerSTR · Arlington, VA · 4 locationsup to $224K · 20 h ago
- Senior AI Engineer - ProductMirakl - Labs · Bordeaux, France · 2 locations20 h ago
- Product Manager, Agentic SafetyMistral AI · Paris20 h ago
- Senior AI R&D Engineer – Model Training (f/m/d)Aleph Alpha · Heidelberg; Berlin21 h ago
- AI R&D Engineer – Model Training (f/m/d)Aleph Alpha · Heidelberg; Berlin21 h ago
- LLM Engineer (100% Remote within Poland)Docplanner · Warsaw21 h ago
- LLM Engineer (100% Remote within Spain)Docplanner · Barcelona21 h ago
- Research Engineer - NeoSingapore AI Safety Hub · Remote/Flexibleup to $180K · 22 h ago
- Research Scientist - NeoSingapore AI Safety Hub · Remote/Flexibleup to $200K · 22 h ago
- GenAI ArchitectPoland and Middle-Eastern Europe · Bulgaria; Poland; Romania22 h ago
- Lead AI Architect - Build PA's AI CapabilityPA Consulting · Copenhagen, Denmark23 h ago
- AI EngineerNielsenIQ · Pune, MH, India23 h ago
- AI Engineer, DevEx & AutomationMirakl - Labs · Bordeaux, France · 2 locations23 h ago
- Applied AI Engineer (LLM)Sporty Group · EMEA1 days ago
- LLM Engineer — Post-Training (Remote - UK)EverAI · United Kingdom; Portugalup to €125K · 1 days ago
- LLM Engineer — Post-Training (Remote - Germany)EverAI · Germany; Portugalup to €125K · 1 days ago
- LLM Engineer — Post-Training (Remote - Portugal)EverAI · Spain; Portugalup to €125K · 1 days ago
- LLM Engineer — Post-Training (Remote - Poland)EverAI · Poland; Portugalup to €125K · 1 days ago
- LLM Engineer — Post-Training (Remote - Netherlands)EverAI · Netherlands; Portugalup to €125K · 1 days ago
- LLM Engineer — Post-Training (Remote - Italy)EverAI · Italy; Portugalup to €125K · 1 days ago
- LLM Engineer — Post-Training (Remote - Spain)EverAI · Spainup to €125K · 1 days ago
- LLM Engineer — Post-Training (Remote - France)EverAI · France; Portugalup to €125K · 1 days ago
- Senior AI Compliance AnalystIvanti · Remote, US, United States1 days ago
- Software Engineer (Mid) - Backend AI EngineerNielsenIQ · Yokneam Illit, Israel1 days ago
- Senior/Principal Applied ScientistMicrosoft · London, England, GBup to £123K · 1 days ago
- Staff AI Platform EngineerServiceNow · Hyderabad, India1 days ago
- Full Stack Engineer — AI Agents & ChannelsNavan · Tel-Aviv, Israel1 days ago
- AI Security Intern, VulcanAIFT · Taipei / SouthEast Asia1 days ago
- AI Research InternOpusClip · Mountain View; Remoteup to $28/h · 1 days ago
- Applied AI Architect, Beneficial DeploymentAnthropic · Sydney, Australia1 days ago
- AI EngineerCentury Health · New York Cityup to $200K · 1 days ago
- Staff Machine Learning Engineer (Research Scientist) - DFAIPlaid · Remote United States; Seattle Officeup to $368K · 1 days ago
- Product Manager, AI Trip PlanningAirbnb · San Francisco, CAup to $282K · 1 days ago
- AI/ML Engineer Intern – Generative AI, PhD – Summer 2027 (Mountain View, CA)LinkedIn · Mountain View, CA, United Statesup to $75/h · 1 days ago
- AI/ML Engineer Intern – Search and Recommender Systems, PhD – Summer 2027 (Mountain View, CA)LinkedIn · Mountain View, CA, United Statesup to $75/h · 1 days ago
- Principal Technical Program Manager - AI-Enabled Incident Response & EvictionMicrosoft · Redmond, WA, US; Mountain View, CA, USup to $275K · 1 days ago
- Software Engineering Lead - Multimodal AI ProductsG2 · Remote (US)up to $300K · 1 days ago
- Sr. Applied Scientist, AWS Applied AI Solutions - Life SciencesAmazon · Seattle, Washington, USA1 days ago
- Firmware Engineer - AISchweitzer Engineering Laboratories, Inc. · Washington - Pullmanup to $134K · 1 days ago
- Applied Machine Learning Scientist IIThe Toronto-Dominion Bank (Canada) · Toronto, Ontarioup to CA$154K · 1 days ago
- Senior AI EngineerDoubleVerify Solutions India Private Limited · NYC Global HQ · 2 locations1 days ago
- Distinguished, Machine Learning EngineerSam's East, Inc. · IN KA BANGALORE Home Office PTPP11 days ago
- Machine Learning Engineer, Fraud (Crypto & Debit Card)PayPal, Inc. · 2 Locations1 days ago
- Senior Officer, AI Safety & Guardrails, U.S. ProgramGates Foundation · 2 Locationsup to $295K · 1 days ago
- Senior Full Stack AI/ML EngineerLPL Financial Corp · 2 Locationsup to $160K · 1 days ago
- ML Data EngineerINFORMATION HANDLING SERVICES MEXICO SA DE CV · Hyderabad, Telangana1 days ago
- AI Platform Product ManagerWorkiva Inc. · USA - Remoteup to $290K · 1 days ago
- Applied Scientist, Amazon Leo Satellite Build SystemsAmazon · Bellevue, Washington, USA · 2 locations1 days ago
- Applied AI/Data Science ManagerHartford Fire Ins. Co · 4 Locationsup to $190K · 1 days ago
- AI ComposerWORKSHARE LTD · Denver, CO · 2 locationsup to $150K · 1 days ago
- Senior Engineer - DevOps & Platform Engineering (AI-Driven Developer Productivity) - BengaluruOmnissa International Unlimited Company · Bengaluru, India1 days ago
- AI EngineerWMEGmbh Wellington Management Europe GmbH · Boston, MA, United Statesup to $180K · 1 days ago
- Principal Data & AI Engineer, Reporting and InsightsExpedia, Inc. · USA - California - San Joseup to $349K · 1 days ago
- Principal AI Agent Engineer – Agentic AI & LLM ApplicationsAT&T Mobility Services LLC · 4 Locationsup to $261K · 1 days ago
- Sr. Applied Scientist, Foundation ModelAmazon · Wilmington, Massachusetts, USA1 days ago
- Clinical Content Specialist – Clinical AI Evaluation SpecialistLibra Technology GmbH · USA - Waltham, MAup to $149K · 1 days ago
- Machine Learning EngineerWorkday, Inc. · USA, CA, Pleasanton1 days ago
- Intern, AI & Data (Applied AI/Machine Learning), Summer 2027Lucid Motors · Newark, CAup to $72/h · 1 days ago
- Member of Technical Staff, Annotation UIMercor · San Franciscoup to $400K · 1 days ago
- Principal Engineer, LLMUpstart · United States | Remoteup to $330K · 1 days ago
- Staff Software Engineer- Agentic AI - FederalServiceNow · Santa Clara, CALIFORNIA, United Statesup to $308K · 1 days ago
- Staff Machine Learning Engineer, Ads Lightweight RankingPinterest · San Francisco, CA, US; Remote, USup to $390K · 1 days ago
Related
AI jobs using PythonAI jobs using LLMsAI jobs using AWSAI jobs using PyTorchAI jobs using RAGAI jobs using AzureAI jobs using C++AI jobs using KubernetesAI jobs using SQLAI jobs using GPUAI jobs using GCPAI jobs using Distributed SystemsAI jobs using TensorFlowAI jobs using TypeScriptAI jobs using RLAI jobs using SparkAI jobs using GoAI jobs using React