English | 简体中文

AI Gateway API is the control-plane core component of AI Gateway. It provides APIs for creating, storing, and distributing policies/configurations. Built on top of the open-source BFE project, it offers unified traffic gateway management for AI scenarios.

AI Gateway consists of the following core components:

• AI route management: Route configuration for multiple AI model providers (OpenAI, DeepSeek, Anthropic, Google Gemini, etc.)
• API key management: Create/delete/validate API keys for AI services
• Domain management: Bind domains and configure routing rules
• Certificate management: Upload and manage TLS certificates
• Cluster/sub-cluster management: Manage backend service clusters
• Traffic management: Traffic allocation and scheduling
• Dashboard integration: Container image bundles the Web console UI
• Config export: Export configuration for BFE data plane and Conf Agent

• Go 1.22 or later
• MySQL 8
• Redis 6.2

# Clone repo
git clone https://github.com/rainway-ai-gateway/ai-gateway-api.git
cd ai-gateway-api

# Download deps and build
make

# Artifacts are in output/

mysql -u{user} -p{password} < db_ddl.sql

Edit conf/ai_gateway_api.toml. At minimum, update the database connection:

[Databases.bfe_db]
DBName               = "open_bfe"
Addr                 = "127.0.0.1:3306"
User                 = "{user}"
Passwd               = "{password}"

For detailed configuration parameters, see 配置文件说明.

./ai-gateway-api -c ./conf -sc ai_gateway_api.toml -l ./log

After startup:

• API port: 8183 (default)
• Monitoring port: 8284 (default)
• Dashboard: open http://localhost:8183 (default username/password: admin / admin)

See the ai-gateway-demo repository:

• https://github.com/rainway-ai-gateway/ai-gateway-demo

Contributions are welcome! See CONTRIBUTING.md for the development workflow and guidelines.

AI Gateway API is released under the Apache License 2.0.