attention head AI jobs Alerts Saved
Jobs › AfterQuery

Software Engineer - RL Environments

AfterQuery · San Francisco
Apply on AfterQuery's site
Tailor my resume
Posted
Apr 14, 2026
Last verified
19 min ago
Salary
$260K – $290K / year
Employment
FullTime
Level
Mid
Function
Software Engineering
AI roleLLMsRL

42% above the median for mid-level Software Engineering roles in the United States · median $193K a year, from 1,780 roles that state pay

Open 7 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.

ABOUT AFTERQUERY

AfterQuery https://www.afterquery.com/ is an applied research lab curating data solutions for foundation model development. We serve every frontier AI lab with the mission of delivering the best data to power the best models. In doing so, we can make expertise that once took a lifetime to build available to anyone who needs it.

Our customers are the ones building the foundation models themselves and our work sits directly in the loop of how those systems improve. This is a rare opportunity to join a company at a defining moment in AI. Forbes reported that we could be YC's fastest unicorn, reportedly raising at a $3.2 billion valuation. We're based in San Francisco and backed by leading investors including Altos Ventures, BoxGroup, and Y Combinator and angels from Google DeepMind, OpenAI, Anthropic, Meta Superintelligence Labs, and Microsoft AI.

WHY APPLY

Massive Opportunity: Forbes reported that we could be YC's fastest unicorn, reportedly raising at a $3.2 billion valuation, and we're not slowing down.

Founding Impact: You will own and architect core infrastructure systems that power our platform from the ground up.

Equity & Growth: Competitive salary and meaningful equity, giving you a real stake in the company's success. Join at an early stage, grow alongside the business, and participate directly in the upside you help create. As we scale, so will your opportunities, responsibilities, and impact.

Strong Team: Work alongside world-class engineers, researchers, and operators.

OVERVIEW

As a SWE (Environments), you will design the simulations, data, and evaluations that directly influence how frontier models learn. You'll work hands-on with research teams at top AI labs, experimenting with environment design, piloting novel data creation strategies, diagnosing model failure modes, and developing the metrics that determine whether a model is actually improving. You'll go from hypothesis to live experiment quickly, and your output will feed directly into model training runs at scale. Day to day, you will design environments, tasks, and data that expose meaningful failure modes across domains like finance, code, and enterprise workflows. You will build and refine reward signals for various RL pipelines. You will develop quantitative frameworks for measuring dataset quality, diversity, and downstream impact on alignment and capability. You will partner with lab research teams to translate their training objectives into concrete data and evaluation specifications.

RESPONSIBILITIES

Partner with lab research teams to translate their training objectives into concrete data and evaluation specifications

REQUIRED QUALIFICATIONS

PREFERRED QUALIFICATIONS

COMPANY BENEFITS (FOR ELIGIBLE EMPLOYEES):

We are an equal opportunity employer committed to providing a workplace free from discrimination and harassment. Employment decisions are made without regard to legally protected characteristics under applicable federal, state, or local law.

We comply with applicable pay transparency requirements and provide compensation ranges based on the position, qualifications, experience, and other relevant factors. Reasonable accommodations are available to qualified individuals with disabilities and for sincerely held religious beliefs, as required by law. This job description is intended to describe the general nature and level of work performed and is not an exhaustive list of all duties, responsibilities, qualifications, or working conditions associated with the position. We reserve the right to modify this job description as business needs change.

Apply on AfterQuery's site

Attention Head lists this role as published on AfterQuery's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All mid-level Software Engineering roles in the United States →

More roles at AfterQuery

All roles at AfterQuery →