attention head AI jobs Alerts Saved
Jobs › Cortea AI

Senior/Staff AI Engineer, Quality & Evals (m/f/x)

Cortea AI · Berlin
Apply on Cortea AI's site
Tailor my resume
Posted
Oct 8, 2026
Last verified
4 h ago
Employment
FullTime
Level
Staff+
Function
AI/ML Engineering
AI rolePythonGCPDistributed SystemsLLMsEvals

ABOUT US

We’re Cortea, a Berlin startup transforming audits with AI. Manual, document-heavy audits waste expert time while demand keeps rising. Our AI-powered software and specialized AI agents remove the repetitive work so auditors can focus on judgment.

Backed by top-tier VCs with >15m EUR funding, with a working product and paying customers, we’re rapidly scaling.

We value first-principles thinking, speed, trust, and kindness. We build side by side in our Berlin office.

YOUR ROLE

We are looking for an engineer with strong backend, data, and AI systems experience to build the evaluation and observability foundation for production-grade LLM agents used in complex audit workflows.

This role sits at the intersection of backend engineering, data infrastructure, and AI quality. You will build the evaluation systems that power our multimodal retrieval agents and continuously improve critical quality metrics across current and future pipelines.

You’ll work at the edge of applied AI and information retrieval, building multimodal agentic pipelines and solving hard context and agent-harness engineering problems.

This is not a traditional analytics, BI, or dashboarding role. You should expect to write production code, design data architecture, work inside backend systems, and directly improve the quality, cost, reliability, and performance of LLM-based agents.

WHAT YOU’LL DO

You will help build and operate the technical systems around our AI agents, with a focus on data infrastructure, evaluation, observability, and optimization. You will:

YOU WILL FIT INTO THE ROLE IF YOU...

NICE-TO-HAVES THAT ARE A PLUS:

No-one checks every box. If you’ve shipped retrieval systems and like owning evaluations and pipelines, let’s talk.

WHAT WE OFFER

INTERVIEW PROCESS

We’re an equal-opportunity team and encourage women and underrepresented groups to apply.

[https://app.ashbyhq.com/api/images/user-content/316125b8-3855-479e-a082-a30caf346d45/1ddbeed3-b4e6-4a47-8872-d5cfeee3e842/image.png]

Apply on Cortea AI's site

Attention Head lists this role as published on Cortea AI's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All staff and principal AI/ML Engineering roles in Germany →

More roles at Cortea AI

All roles at Cortea AI →