Software Engineer, AI Gateway
Are you ready to unlock intelligence?
If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.
THE MISSION
You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation. As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more.
WHAT YOU’LL DO
- Partake in the entire lifecycle of core AI Gateway features, from design to production rollout.
- Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua.
- Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.
- Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling.
- Troubleshoot production issues in the hot path.
- Work with product management and other engineering teams to turn customer requirements into reliable, documented product features.
WHAT YOU’LL BRING
THE TOOLKIT
- 3+ years of programming in server-side applications and components, in a language such as Rust or Go.
- Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
- Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC).
- Familiarity with cutting-edge AI models concepts, agentic AI protocols, and AI applications development.
- Solid hands-on expertise in Linux systems.
THE KONG DNA
- Ownership: You have a strong sense of ownership, including the documentation: engineers at Kong write the documentation for their products.
- Collaboration: You have excellent verbal and written communication skills and are comfortable working with a remotely distributed team.
BONUS POINTS
- Proficiency with Lua.
- Hands-on experience with NGINX and OpenResty.
- Familiarity with cloud-native environments (Kubernetes, Docker, AWS/GCP/Azure).
#LI-EA1
About Kong:
Kong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit www.konghq.com http://www.konghq.com.
Attention Head lists this role as published on Kong's own job board. Applications go to the employer.
Similar roles at other employers
- Legal EngineerHarvey · Milan€130K–170K
- Process Engineer IT/OT Automation & AIBorgWarner Ithaca LLC · Arcore - ItalyOct 16, 2026
- Software Engineer – AI/ML PlatformPrima · Milan€55K–85K
- CFD & Aerodynamic Engineer (AI Training & Evaluation)Lifted, an Upwork Company™ · Rome, Lazio, Italy$80–110/h
- Computer Science PhD (Italy)Anyone AI · Italy$150/h
All mid-level Software Engineering roles in Italy →
More roles at Kong
- AI Evangelist - APJAustraliaNov 20, 2026
- Nov 20, 2026
- Staff Solution Engineering, AI Connectivity (UK)England, United KingdomNov 5, 2026
- AI Evangelist - EMEAEngland, United KingdomNov 4, 2026
- Forward Deployed Engineer AI Gateway EMEAEngland, United KingdomNov 4, 2026
- Staff Solutions Engineer - AI SpecialistSan Francisco, California, United StatesOct 26, 2026
- Oct 26, 2026
- Senior Software Engineer, AI GatewayMilan, ItalyOct 26, 2026