Skip to content

[codex] Add KIS proxy cache and outbound rate limiter#14

Merged
smallfish06 merged 1 commit intomainfrom
codex/kis-proxy-cache
May 1, 2026
Merged

[codex] Add KIS proxy cache and outbound rate limiter#14
smallfish06 merged 1 commit intomainfrom
codex/kis-proxy-cache

Conversation

@smallfish06
Copy link
Copy Markdown
Owner

Summary

  • add an in-process KIS proxy cache with endpoint-aware TTLs, singleflight request coalescing, and stale fallback on upstream errors
  • add an outbound KIS proxy rate limiter so cache misses and uncached proxy calls are throttled before reaching KIS
  • expose KIS proxy cache/rate-limit options through the public server API and YAML config
  • keep trading/order/auth endpoints out of cache while still applying outbound throttling

Why

KIS upstream rate limits were surfacing under repeated requester traffic. API-side retries and DB caching reduce some load, but the durable bottleneck belongs inside the requester/krsec layer immediately before CallEndpoint, after cache hits have been resolved.

Validation

  • go test ./pkg/config ./internal/server ./pkg/server
  • go test ./...

@smallfish06 smallfish06 marked this pull request as ready for review May 1, 2026 07:10
@smallfish06 smallfish06 merged commit e47cb6a into main May 1, 2026
5 checks passed
@smallfish06 smallfish06 deleted the codex/kis-proxy-cache branch May 1, 2026 07:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant