K

Kong

High-performance API management and connectivity

Senior Software Engineer - AI Gateway

AI Application EngineeringConfirmed live in the last 24 hours
Full-timeShanghai, ChinaNo salary listedIn-person

About the Job

Requirements

  • At least 8 years of programming experience in server-side applications and components.
  • Experience designing, prototyping, building, and debugging highly scalable, distributed, reliable, and resilient applications.
  • Hands-on low-level technical expertise in Linux systems troubleshooting and profiling.
  • Experience with distributed systems, the Linux networking stack, and computer systems programming; expertise with APIs across Layer 7 and Layer 4 transports and protocols is required.
  • Ability to work with a remotely distributed team.
  • Strong sense of ownership and strong verbal and written communication skills.
  • Familiarity with AI large language model concepts and application development.

Responsibilities

  • Design, build, and maintain Kong’s AI Gateway runtime and its underlying data plane stack.
  • Architect, design, and implement features including proxying capabilities, semantic and intelligent routing, load balancing, guardrails, compression, and identity to extend Kong’s AI Gateway offering.
  • Build and maintain security, performance, and compliance foundations, including token cost management, access control, and low-level optimizations for production AI workloads.
  • Engage with the open-source community and extend Kong core to support current industry trends.
  • Address gaps between Kong AI Gateway and third-party AI and machine-learning providers, deployment platforms, and tooling.
  • Perform additional tasks as required by the manager.

Desired Qualifications

  • Hands-on experience with NGINX, OpenResty, Kong, or LuaJIT.
  • Hands-on experience with Envoy or Istio.
  • Hands-on experience with Rust.
  • Hands-on experience using AI agents to deliver intricate software systems efficiently and with high quality.

About the Company

Kong

High-performance API management and connectivity

Kong provides API management and connectivity for cloud-native applications. Its main products are Kong Gateway, a high-performance API gateway; Kong Konnect, a unified SaaS platform for API management; and Kong Mesh, an enterprise service mesh for coordinating microservices. It differentiates itself by combining an open-source core with premium features, support, and managed services, with a strong focus on Kubernetes and scalable API traffic. The goal is to help businesses build, secure, and scale their APIs and microservices to boost developer productivity and application performance.

Company size
1,001-5,000
Company stage
Series E
Total funding
$345.6M
Headquarters
San Francisco, CA
Founded
2017

Recently Posted Jobs

Explore more opportunities at Kong

See more jobs