attention head AI jobs Alerts Saved
Jobs › Twenty

Staff Product Manager - AI Evals

Twenty · Arlington, VA; New York, NY
Apply on Twenty's site
Tailor my resume
Posted
Oct 22, 2026
Last verified
56 min ago
Salary
$161K – $389K / year
Employment
FullTime
Level
Staff+
Function
Product
AI roleEvals

20% above the median for staff and principal Product roles in the United States · median $230K a year, from 199 roles that state pay

ABOUT THE COMPANY

America is under sustained cyber attack. Our adversaries infiltrate our networks, steal our IP, and degrade the digital infrastructure that modern life runs on. They’ve learned—correctly—that those attacks rarely produce consequences.

Twenty was founded to change that, by making our adversaries think twice before they attack us. Our vision is American and allied primacy in cyberspace—a future where they cannot contest us, deterrence is assured, and the free world remains secure.

Founded in 2024, Twenty Technologies (www.twenty.io http://www.twenty.io) industrializes offensive cyber operations for the U.S. and its allies. Headquartered in Arlington, Virginia, Twenty has raised $168M from Khosla Ventures, Accel, Caffeinated Capital, Friends & Family Capital, Point72 Ventures, General Catalyst, and In-Q-Tel.

Mission | On Site | Full Time | U.S. Citizenship Required / No Active Clearance Required

ROLE SUMMARY

Twenty builds AI-enabled technology for mission-critical cyber operations. We're seeking a Staff Product Manager to help make agentic AI systems measurable, reliable, and continuously improvable. You’ll partner with AI and engineering teams to shape evaluation capabilities—from defining agent performance and product quality to turning results into useful workflows and product decisions.

The strongest candidates will bring meaningful experience building or managing agentic systems, either by directly building evaluations or by building the systems that enable teams to evaluate and improve agents. Cyber experience is a plus, but not required.

WHO YOU ARE

WHAT YOU’LL DO

MUST HAVE

NICE TO HAVE

Benefits
What's on the table:

Benefits vary by location, role, and eligibility. Full plan details provided during the interview and offer process.

If this role sounds like you, apply and share with us your interest

Due to U.S. government contract and security requirements, this role is limited to U.S. citizens. Some positions may also require eligibility to obtain and maintain a U.S. Government security clearance. Any active clearance requirement will be listed in the role description.

Twenty is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, veteran status, disability, or any other protected status, consistent with applicable law.

If you need a reasonable accommodation during the hiring process, let us know and we will work with you.

Apply on Twenty's site

Attention Head lists this role as published on Twenty's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All staff and principal Product roles in the United States →

More roles at Twenty

All roles at Twenty →