K

Kong

High-performance API management and connectivity

Senior Software Engineer - AI Gateway

AI Application EngineeringUpdated on Nov 16
Full-timeMilan, Metropolitan City of Milan, Italy€77.2k - €95.3k /yrHybrid

About the Job

Requirements

  • At least 5 years of programming experience in server-side applications and components using a language such as Rust or Go.
  • Experience building and debugging highly scalable, distributed, reliable, and resilient applications.
  • Knowledge of networking fundamentals and Layer 4 and Layer 7 protocols, including TCP/IP, HTTP/2, and gRPC.
  • Understanding of API design and familiarity with API gateways, proxies, or service mesh.
  • Experience with large language models and AI infrastructure, such as LLM provider APIs, agent frameworks, model serving, MCP, and other agentic AI protocols.
  • Hands-on expertise in Linux systems, including troubleshooting memory issues and profiling processes.
  • Ability to take full ownership of work from concept to production, including writing product documentation.
  • Ability to balance quality with delivering customer value quickly.
  • Ability to communicate clearly in writing and work effectively with a remotely distributed team.
  • Ability to make and explain technical trade-offs where there is no established playbook.

Responsibilities

  • Own the technical direction for core AI Gateway features, from design through production rollout.
  • Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua.
  • Implement gateway features including multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.
  • Design integrations with LLM providers and AI platforms, addressing gaps between Kong and third-party deployment platforms and tooling.
  • Influence the technical roadmap and architecture, and address technical debt before it limits scalability.
  • Investigate complex production issues and performance bottlenecks, and perform low-level optimizations in the hot path.
  • Work with product management and other engineering teams to turn customer requirements into reliable, documented product features.
  • Mentor other engineers through code reviews and design discussions.

Desired Qualifications

  • Contributions to open-source software projects.
  • Proficiency with Lua.
  • Hands-on experience with NGINX and OpenResty.
  • Experience operating services in cloud-native environments using Kubernetes, Docker, AWS, GCP, or Azure.

About the Company

Kong

High-performance API management and connectivity

Kong provides API management and connectivity for cloud-native applications. Its main products are Kong Gateway, a high-performance API gateway; Kong Konnect, a unified SaaS platform for API management; and Kong Mesh, an enterprise service mesh for coordinating microservices. It differentiates itself by combining an open-source core with premium features, support, and managed services, with a strong focus on Kubernetes and scalable API traffic. The goal is to help businesses build, secure, and scale their APIs and microservices to boost developer productivity and application performance.

Company size
1,001-5,000
Company stage
Series E
Total funding
$345.6M
Headquarters
San Francisco, CA
Founded
2017

Recently Posted Jobs

Explore more opportunities at Kong

See more jobs