attention head AI jobs Alerts Saved
Jobs › You.com

Senior Backend Engineer, Inference Platform

You.com · San Francisco, CA, New York, NY (Remote)
Apply on You.com's site
Tailor my resume
Posted
Mar 2, 2025
Last verified
5 h ago
Salary
$200K – $250K / year
Level
Senior
Function
Software Engineering
AI roleRemotePythonKubernetesLLMsEvalsGPU

13% above the median for senior Software Engineering roles in the United States · median $200K a year, from 1,264 roles that state pay

Open 20 months. Roles open this long are often filled, or kept open all year. Check the date on the employer's site before you apply.

Not mentioned in the posting. You.com filed 4 H-1B, H-1B1 or E-3 applications for AI roles in FY2025–FY2026, 2 for workers changing employer. Its US visa filings

About Us

At You.com, we are building the AI Search Infrastructure that powers modern AI systems. Our goal is to create the trusted knowledge layer that agents, applications, and enterprises rely on to retrieve real-time, accurate, and citation-backed information.

Our platform combines proprietary vertical indexes with LLM-optimized retrieval systems to power AI agents, applications, and enterprise workflows. We are solving hard problems across search, large language models, and large-scale infrastructure to make AI systems more reliable, transparent, and useful.

Our team includes engineers, researchers, product builders, and operators who care about solving meaningful problems and delivering real-world impact. Whether you are improving core infrastructure, shaping product experiences, or helping bring new AI capabilities to market, your work will help define how modern AI finds and uses knowledge.

About the Role

Every model call from our products and customers passes through one layer: our inference gateway. It allows users to select a model and we intelligently route the call to optimize on cost , latency and high availability. We are now building the control plane above it, to manage and govern access, performance and cost.

You will own and scale that gateway. The work sits between model serving and product: routing and fallback across hosted providers and our own models, cache-aware routing decisions, metering accurate enough to bill on, and enforcement on the request path within a single-digit-millisecond budget.

This is a remote position open to candidates based anywhere in the United States. We give preference to candidates in the San Francisco Bay Area or New York, where we have offices, but we are happy to consider strong remote candidates elsewhere in the US.

Responsibilities

Qualifications

Nice to Have

Our salary bands are structured based on a combination of geographic tiers and internal leveling. Compensation is determined by multiple factors assessed during the interview process, with the final offer reflecting these considerations.

Salary Band
$200,000—$250,000 USD

Company Perks:

•
Hubs in San Francisco and New York City offering regular in-person gatherings and co-working sessions

•
Flexible PTO with U.S. holidays observed and an end of year shutdown in December to rest and recharge*

•
A competitive health insurance plan covers 100% of the policyholder and 75% for dependents*

•
12 weeks of paid parental leave in the US*

•
401k program, 3% match - vested immediately!*

•
$500 work-from-home stipend to be used up to a year of your start date*

•
$1,200 per year Health & Wellness Allowance to support your personal goals*

•
The chance to collaborate with a team at the forefront of AI research

*Benefits eligibility varies by employment type and tenure.

You.com participates in E-Verify. We will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS) with information from each new employee’s Form I-9 to confirm work authorization. (English/Spanish: E-Verify Participation/Right to Work) We are also an inclusive, equitable, and accessible workplace. Please let us know if you require accommodation for any portion of the recruitment and hiring process.

Beware of Recruiting Scams:

You.com will only contact you through official @You.com email addresses and will never ask for payment or sensitive personal information during the hiring process.

Use of AI Tools During Our Hiring Process:

At You.com, we're thoughtful about how we use AI throughout our business — including our hiring process.

During certain stages of the interview process, we may use AI-powered tools to assist with administrative tasks such as scheduling, note-taking, transcription, or summarizing interview discussions. These tools are intended to support our interviewers by improving accuracy and efficiency — they do not make hiring decisions or replace human judgment.

All employment decisions are made by our recruiting team and hiring managers based on a holistic review of each candidate and applicable evaluation criteria.

If AI-assisted note-taking or transcription may be used during your interview, we will notify you in advance. If you prefer not to participate in an interview that uses these tools, you may opt out by informing your recruiter before your scheduled interview. We will work with you to provide an alternative interview experience where reasonably practicable.

Information collected during the hiring process is handled in accordance with our Privacy Policy and applicable law. By continuing with the application process, you acknowledge that you have read this notice. If AI-assisted tools are used during your interview and you have not opted out after receiving notice, you consent to their use as described above, where permitted by applicable law.

Apply on You.com's site

Attention Head lists this role as published on You.com's own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Software Engineering roles in the United States →

More roles at You.com

All roles at You.com →