This collaboration comes in response to the growing need for AI traffic control and management systems as services utilizing generative AI and large language models (LLMs) expand. As enterprise AI adoption expands into actual services and business environments, there is growing demand for a gateway-type system that can integrate authentication, security, and monitoring management.
In environments where LLM calls are made via API, traffic management complexity is also increasing as multiple model providers, retrieval-augmented generation (RAG), Model Context Protocol (MCP), and agent-to-agent (A2A) communication are used together. Kong has extended the functionality of its existing API gateway platform, Kong Gateway, into the AI and agent traffic management domain and introduced Kong AI Gateway.
Kong AI Gateway is built on the same runtime as Kong Gateway and is configured to manage calls to multiple LLM providers through a single interface. Along with existing API management functions such as authentication/authorization, usage control, and audit logs, it also provides features such as personally identifiable information (PII) filtering, prompt management, caching, and traffic monitoring.
Along with supplying the product, CloudNetworks plans to provide architecture design tailored to customer environments, system implementation, integration, and technical support. It supports enterprises in building their AI management systems by linking existing AI operating environments with the gateway layer.
Heung-gyun Jung, CEO of CloudNetworks, said, "As generative AI is applied to business operations, enterprises need to consider not only model performance but also control and observation of AI calls. Through the supply of Kong AI Gateway, we will support enterprises in building their AI operations and management systems."
David Callisch, Vice President of Kong for Asia Pacific, India, and Japan, said, "This is a time when adoption of AI Gateway is expanding among domestic companies in finance, manufacturing, retail, and other sectors. Through cooperation with CloudNetworks, we will support enterprises in building their AI management systems."
Source: Gokorea News (https://www.gokorea.kr)