An AI gateway product that manages the model calls and data flows generated when enterprises use generative artificial intelligence (AI) is now being supplied domestically. The approach manages multiple large language models (LLMs) within a single system and applies authentication, security, and monitoring functions.
On the 18th, CloudNetworks announced that it has signed a partnership with Kong, a global API and AI connectivity company, and will begin distributing "Kong AI Gateway" in Korea.
The two companies plan to support AI traffic management and governance for enterprises applying generative AI and LLMs to actual business operations and services. They will provide a system for centrally managing authentication, security, and monitoring needed in the LLM call process.
LLMs are mainly called via API, and multiple model providers, retrieval-augmented generation (RAG), Model Context Protocol (MCP), and inter-agent calls are used together. Kong AI Gateway is designed to manage the API and agent-to-agent (A2A) traffic that occurs in such environments.
Kong AI Gateway uses the same runtime as the existing Kong Gateway and manages calls to multiple LLM providers through a single standard interface. Policies previously applied to existing APIs—such as authentication and authorization, rate limiting, and audit logs—can also be applied to AI calls.
At the gateway level, it also provides personally identifiable information (PII) filtering, prompt control, semantic caching, and traffic observability functions. It is designed so that enterprises can manage multiple AI models and their related traffic from a single location.
Along with supplying the product, CloudNetworks plans to provide architecture design and system implementation tailored to each company's environment, integration with existing systems, and technical support. It is also pursuing a business of integrating gateway-based management systems with existing AI operating environments.
Heung-gyun Jung, CEO of CloudNetworks, said, "As generative AI is applied to actual business operations, enterprises face a situation where they must consider not only model performance but also how to control and observe AI calls. Based on our experience building AI operating environments, CloudNetworks will supply Kong AI Gateway to support the AI governance systems of domestic enterprises."
David Carless, Vice President of Kong for Asia Pacific, India, and Japan, said, "This year marks an important point when adoption of Kong AI Gateway is gaining momentum among major domestic companies in finance, manufacturing, retail, and other sectors."
Source: NBN TV (https://www.nbntv.co.kr)
