attention head AI jobs Alerts Saved
Jobs › ngrok Inc.

Product Engineer III/Senior, AI Gateway

ngrok Inc. · San Francisco, CA
Apply on ngrok Inc.'s site
Tailor my resume
Posted
May 26, 2026
Last verified
7 h ago
Salary
$203K – $248K / year
Level
Senior
Function
Software Engineering
AI roleNo visa sponsorshipRustGoC++TypeScriptReactKubernetesTerraformAWSLLMs

13% above the median for senior Software Engineering roles in the United States · median $200K a year, from 1,264 roles that state pay

About ngrok Inc.

ngrok builds developer infrastructure to connect services and AI models, wherever they run.

Most developers know us as the way to put localhost on the internet. More than 15 million of them use ngrok, at companies like GitHub, Okta, HashiCorp, and Twilio. It's the same ngrok they've loved and leaned on for years, now with the power to run production traffic at scale.

Teams use ngrok to deliver APIs, connect to their customers' networks, manage device fleets, and route traffic between public and local AI models.

Across all of it, we hold ourselves to one standard: developers should be able to finish a whole job without becoming experts in every system it touches. We take on the complexity, make thoughtful choices by default, and keep developers in control of what matters to them.

A few things you should know:

Still reading? Good. There's more below worth your time.

About the AI Gateway Team

Our AI Gateway team builds the systems that define how AI traffic is identified, controlled, and understood as it passes through ngrok.

We own the AI-specific control plane at the gateway layer: policies, usage tracking, and enforcement that sit directly on live customer traffic. Our systems must behave correctly under real-world conditions—traffic spikes, unexpected model behavior, misconfigured policies, and customers asking, “Why was this blocked?” or “Where did my tokens go?”

What You’ll Actually Do

You Might Be a Great Fit If…

Extra credit if you’ve worked on:

Tech Stack

ngrok runs entirely on AWS. Engineers develop by using remote development tools and/or ssh to connect to remote EC2 environments that run a full Kubernetes cluster of the ngrok stack, closely mirroring production. The codebase is primarily Go and TypeScript. We use Postgres for persistence, Kafka for streaming, Protobuf for service boundaries, and Kubernetes, Terraform, Helm, and Buildkite to operate and ship reliably. React is used for user interfaces, and GitHub supports our development workflows and remembers everything.

Location

This is a remote position for candidates outside of the Bay Area and a hybrid role for candidates within commuting distance to San Francisco. Our Bay Area employees commute to the office on Tuesdays and Wednesdays.

Sponsorship

All candidates must be US-based, and legally authorized to work in the United States.

At this time, ngrok is unable to provide visa sponsorship for this position. Applicants must be authorized to work in the United States on a permanent, ongoing basis without the need for current or future sponsorship.

Compensation

Senior Product Engineer

Product Engineer III

Job level and actual compensation will be evaluated based on factors including, but not limited to, qualifications objectively assessed during the interview process (including skills and prior relevant experience, potential impact, and scope of role), internal equity with other team members, market data, and specific work location. We provide an attractive mix of salary and equity.

#LI-Hybrid
Full Time Employee Benefits

Apply on ngrok Inc.'s site

Attention Head lists this role as published on ngrok Inc.'s own job board. Applications go to the employer.

Not this one? Get roles like it weekly

A job alert: the week's best new AI roles from employers' own job boards, every Monday. Unsubscribe in one click.

Similar roles at other employers

All senior Software Engineering roles in the United States →