NeoGate v0.2.0

NeoGate v0.2.0 expands the gateway from a request relay and admin console into a more operationally complete private AI gateway, with scheduled upstream monitoring, richer channel management, improved deployment paths, and refreshed public documentation.

Highlights

• Added a dedicated neogate-scheduler workspace package for scheduled background jobs.
• Added scheduled upstream channel probes, including per-channel probe samples, latency/status tracking, and automatic cleanup of old probe history.
• Added scheduled upstream model catalog sync for enabled OpenAI-compatible endpoints, with discovered models recorded into provider and channel model state.
• Added channel model runtime state so routing, diagnostics, pricing readiness, missing models, cooldowns, and probe results can be managed at the model level.
• Added upstream channel diagnostics in the admin console, including endpoint checks, /v1/models discovery, probe requests, missing-model reporting, and recent probe trend visualization.
• Added first-class upstream channel key management, including create, list, reveal, update, delete, enable/disable, health, cooldown, and last-used metadata.
• Refined admin channel management with improved endpoint/model editors, model fetching, pricing readiness indicators, runtime switches, responsive model detail tables, and clearer localized text.
• Added a China-specific Docker Compose file, docker-compose.cn.yml, with preconfigured image, Cargo, APT, and npm mirrors for easier mainland China deployments.
• Added Windows install script generation and improved install command behavior, setup prompts, clipboard handling, bootstrap health endpoints, and npm mirror support.
• Added source and cluster deployment documentation in English and Chinese, including explicit scheduler startup guidance.
• Added a bilingual static website, comparison pages, refreshed repository presentation, roadmap, security policy, contribution guide, and GitHub issue/PR templates.
• Improved Docker build reliability with a root Cargo workspace, lockfile, configurable mirrors, and combined backend/scheduler release builds.
• Improved image-task compatibility by preserving image_format for async image tasks and adjusted Nginx sendfile behavior for streamed or generated assets.
• Continued admin UI consistency work across tables, status switches, pagination, scroll behavior, and narrow viewport layouts.

Version

• Target branch: main
• Tag: v0.2.0
• License: AGPL-3.0-only

NeoGate v0.1.2

NeoGate v0.1.2 introduces project-centered governance, a more consistent admin console, and stronger relay, billing, and image-task behavior for private production deployments.

Highlights

• Added Projects as the primary unit for members, API keys, balances, usage attribution, and cost analysis.
• Added an admin Projects page for creating projects, assigning owners and members, switching project status, adjusting project balances, and viewing project-level key counts.
• Added project member API keys so each project member can receive a scoped key while shared project ownership remains clear.
• Aligned paid-mode credit flows with the Project model, including project balances, project-level usage attribution, and improved paid-mode request handling.
• Improved user management with username support, project/key visibility, cleaner status controls, and more consistent pagination and action dialogs.
• Optimized the relay hot path and billing outbox throughput, including configurable usage buffering, improved cache boundaries, and better request-path logging.
• Added local background handling for OpenAI-compatible Responses image generation through NewAPI, including response status retrieval, cancellation, asset storage, and result reconstruction.
• Added concurrency limits for synchronous image requests with global and per-key controls.
• Improved OpenAI-compatible image relay behavior, async image response buffering, and Nginx streaming defaults for long-running model and image requests.
• Refined the admin console UI across channels, credentials, projects, users, usage, and settings with more consistent table layouts, status switches, pagination bars, scroll behavior, and confirmation dialogs.
• Expanded public API documentation and README presentation, including clearer enterprise private deployment positioning and richer interface examples.
• Added design documentation for the Project model and Billing Outbox flow.
• Reorganized backend tests into smoke and benchmark folders, with Chinese and English test documentation.

Upgrade Notes

• Rebuild Docker images after pulling this release so the backend, frontend, and Nginx runtime config are updated together.
• Use the new admin Projects page for project balances, member management, and project-scoped API key operations.
• If you use background Responses image generation with NewAPI, keep NEOGATE_ASSET_DIR on persistent writable storage. The default is data/assets.
• In distributed deployments, keep a worker process running because background response jobs, upstream task polling, usage aggregation, and billing outbox processing depend on worker execution.
• Review the new optional tuning variables when running high-volume image workloads:
  • NEOGATE_RESPONSE_RETENTION_SECONDS
  • NEOGATE_IMAGE_SYNC_GLOBAL_LIMIT
  • NEOGATE_IMAGE_SYNC_KEY_LIMIT
  • RELAY_USAGE_BUFFER_LIMIT_BYTES
  • UPSTREAM_TIMEOUT_SECONDS
• If you maintain custom Nginx files, copy the streaming timeout and buffering settings from deploy/nginx/compose.conf.template or deploy/nginx/standalone.conf.example.

Version

• Target branch: main
• Tag: v0.1.2
• License: AGPL-3.0-only

NeoGate v0.1.1

NeoGate v0.1.1 focuses on broader provider compatibility, a much richer public API reference, and smoother Docker-based deployment.

Highlights

• Added NewAPI as a built-in upstream provider option, including admin console support and provider icon assets.
• Expanded OpenAI-compatible API coverage with image generation, image edits, image variations, async image workflows through Responses, embeddings, model listing, and SDK examples.
• Improved OpenAI and Anthropic relay internals by splitting provider-specific logic into dedicated provider modules.
• Added compatibility handling for NewAPI image responses and additional upstream response formats.
• Added a public Interfaces page with Chinese and English API examples for OpenAI-compatible and Anthropic-compatible endpoints.
• Improved usage, billing, and setup flows across the admin console and user dashboard.
• Added OpenAI image smoke tests and image edit streaming coverage.
• Fixed Docker deployment issues around Rust toolchain compatibility, pnpm version selection, and writable runtime configuration.
• Split Nginx deployment config into Compose and standalone examples for clearer deployment paths.

Deployment Notes

Docker Compose remains the recommended way to try or deploy NeoGate:

docker compose up -d --build

Then open:

http://SERVER_IP:8080

For source builds, NeoGate now requires Rust 1.94 or newer because the current backend dependency set requires that compiler version.

Upgrade Notes

• Rebuild Docker images after pulling this release so the backend uses the Rust 1.94 builder image and the updated runtime config directory permissions.
• If an existing standalone Docker deployment reports Permission denied (os error 13) during first-run setup, fix the existing config volume once:

docker compose exec -u root backend sh -lc 'chown -R neogate:neogate /app-config'

• The Nginx example files were renamed:
  • deploy/nginx/compose.conf.template for Docker Compose
  • deploy/nginx/standalone.conf.example for standalone Nginx deployment

Version

• Target branch: main
• Tag: v0.1.1
• License: AGPL-3.0-only

NeoGate v0.1.0

NeoGate v0.1.0

This is the first public release of NeoGate.

NeoGate is a lightweight LLM API gateway built with Rust. It provides a unified entry point for managing upstream model providers, access keys, model routing, and usage tracking.

Highlights

• OpenAI-compatible and Anthropic-compatible API endpoints
• Team/internal mode and billing mode
• User API key management without exposing upstream provider credentials
• Admin management for channels, credentials, model pricing, users, and service settings
• Usage tracking for users and API keys
• Credit balance, recharge, and payment configuration support
• Automatic cooldown and failover for unhealthy upstream keys
• First-run setup wizard for admin, database, site, SMTP, payment, and provider configuration
• Docker Compose examples for standalone and cluster deployment
• Admin console, user dashboard, and public documentation pages

Quick Start

Start NeoGate with Docker Compose:

docker compose up -d --build

Then open:

http://SERVER_IP:8080

Follow the first-run setup wizard to complete initialization.

Version

• Target branch: main
• Commit: 79c3d90
• License: AGPL-3.0-only