attention head AI jobs Alerts Saved
Jobs › Terac

AI Evaluators: Assessing A Shopping Assistant

Terac · United States
Apply on Terac's site
Tailor my resume
Posted
Nov 11, 2026
Last verified
1 h ago
Employment
Contract
Level
Mid
Function
Other
AI roleRemoteEvals

WHAT WE'RE RESEARCHING

We're hiring AI evaluators to assess the accuracy and helpfulness of a new digital shopping assistant. This project focuses on understanding how well the system handles real-world e-commerce queries and where it falls short in its logic. Your analysis will directly feed into improving the underlying model and its response quality.

HOW IT WORKS

You will review real interaction traces between users and the shopping assistant within our custom platform. As you analyze these conversations, you will pinpoint specific failures, logical errors, or unhelpful product recommendations. From there, you will create structured rubrics and verifiers to consistently judge future response quality. This is an ongoing remote engagement requiring 20+ hours per week.

WHO THIS IS FOR

This opportunity is ideal for quality assurance specialists, AI data evaluators, and e-commerce professionals with a strong eye for detail. We welcome applicants with prior experience in prompt engineering, complex data annotation, or software testing. You should be comfortable analyzing text interactions deeply and building structured evaluation frameworks from scratch.

WHAT YOU'LL DO

WHO SHOULD APPLY

COMPENSATION

$50 per hour

READY TO PARTICIPATE?

Start your paid interview now https://terac.com/interview/start/r/c5aab5ae-fa85-45ab-918d-a8b7cdf9f0ec?utm_source=ashby_listing_description

ABOUT TERAC

Terac is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use Terac to recruit, screen, and pay study participants across industries, languages, and skill sets.

Learn more at terac.com https://terac.com or on YouTube at @jointerac https://www.youtube.com/@jointerac.

Apply on Terac's site

Attention Head lists this role as published on Terac's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

More roles at Terac

All roles at Terac →