Member of Technical Staff (Site Reliability Engineer, Search Crawler)
Perplexity · London; Belgrade; Dublin
Apply on Perplexity's siteTailor my resume
Posted
Nov 13, 2026Last verified
48 min agoEmployment
FullTimeLevel
Staff+Function
AI/ML EngineeringAI rolePythonRustC++KubernetesTerraform
Keeping a crawler running is not the same as keeping it productive. Queues can grow while servers look healthy, and a small change can become a fleet-wide bottleneck. On Perplexity's Crawler team, you'll improve throughput, plan capacity, and build operational reliability through safer deployments, better observability, and durable fixes.
Responsibilities
- Operate and optimize Kubernetes workloads and supporting infrastructure for crawler services, including fetching and rendering fleets.
- Build and maintain infrastructure as code and CI/CD pipelines, with safe rollouts, validation, and fast rollback.
- Define SLOs and build monitoring, alerting, and observability for availability, latency, throughput, and resource saturation.
- Own capacity planning and resource efficiency; diagnose queue backlogs, network failures, and resource bottlenecks with service owners.
- Participate in the team's on-call rotation, lead incident response, and turn blameless postmortems into durable reliability improvements.
- Write production software to automate diagnosis and routine remediation, with validation and approval gates for high-impact actions.
Qualifications
- 5+ years of experience in SRE, production engineering, or infrastructure-heavy backend roles, with strong programming skills in Python, C++, Rust, or Go.
- Hands-on experience with cloud infrastructure, production Kubernetes, infrastructure as code such as Terraform, and automated deployment workflows.
- Strong Linux and networking fundamentals, including TCP/IP, DNS, TLS, HTTP, and load balancing.
- Experience building observability with tools such as Datadog, Prometheus, or Grafana, and using SLOs to guide reliability improvements.
- Proven experience diagnosing distributed-system failures, leading production incidents, and improving system performance or resource efficiency.
Nice to have
- Experience operating web crawlers, search infrastructure, or browser fleets at scale.
- Experience with distributed queues, backpressure, workload isolation, or multi-region recovery.
Attention Head lists this role as published on Perplexity's own job board. Applications go to the employer.
Similar roles at other employers
- Senior / Staff ML Engineer (Routing & Optimisation)HIVED · London HQNov 17, 2026
- Staff AI Engineer (Security/Infrastructure)Multiverse · LondonNov 17, 2026
- Fullstack AI Engineer (Staff) - IFS LogisticsIFS · Staines-upon-Thames, England, United KingdomNov 17, 2026
- Applied AI Innovation Architect (Cloud Solutions)Microsoft · London, England, GB; Manchester, England, GB; Reading, England, GB; Cheltenham, England, GB£62K–106K
- Principal Generative AI Specialist Solutions Architect, UKI, AGS-WWSO EMEA-All-CSAmazon · London, England, GBRNov 16, 2026
All staff and principal AI/ML Engineering roles in the United Kingdom →
More roles at Perplexity
- Engineering Manager (Agent Verticals)San FranciscoNov 20, 2026
- Nov 19, 2026
- Member of Technical Staff (Index, Search Crawler)London; Belgrade; DublinNov 17, 2026
- Member of Technical Staff (Enterprise Security Engineer)San Francisco; Remote (United States); London; Belgrade; New York City; DublinNov 16, 2026
- Member of Technical Staff (Cybersecurity Solutions Architect)San Francisco; Remote (United States); London; Belgrade; New York City; DublinNov 16, 2026
- Member of Technical Staff (Perplexity Frontier Research)New York City; Palo Alto; London; San FranciscoNov 16, 2026
- Nov 15, 2026
- Member of Technical Staff (Software Engineer, Cybersecurity Products)San Francisco; Remote (United States); London; Belgrade; New York City; DublinNov 13, 2026