Skip to content

multi-process concurrent cobalt instances#879

Merged
github-actions[bot] merged 26 commits intodevelopfrom
reuseport
Nov 2, 2024
Merged

multi-process concurrent cobalt instances#879
github-actions[bot] merged 26 commits intodevelopfrom
reuseport

Conversation

@dumbmoron
Copy link
Member

@dumbmoron dumbmoron commented Nov 1, 2024

  • adds support for storing cache data in redis, configurable with API_REDIS_URL env (redis://localhost:6379)
  • adds ability to spawn multiple cross-communicating cobalt processes using node:cluster, configured with API_INSTANCE_COUNT env
    • requires API_REDIS_URL to be configured
    • ratelimit and stream cache exclusively stored in redis
    • istream cache stored locally on each instance, istreams are bound to specific instance that is serving the stream
    • main instance fetches cookies/api keys, distributes them amongst newly spawned processes
    • works on linux, node >= 23.1.0

@dumbmoron dumbmoron requested a review from wukko November 1, 2024 16:46
@dumbmoron dumbmoron changed the base branch from main to develop November 1, 2024 16:52
@wukko
Copy link
Member

wukko commented Nov 1, 2024

bub fix
-1 +69,420

(i’ll review this banger tomorrow)

@wukko
Copy link
Member

wukko commented Nov 2, 2024

lgtm but i think github action workers died

@wukko
Copy link
Member

wukko commented Nov 2, 2024

lgtm 2

@wukko
Copy link
Member

wukko commented Nov 2, 2024

/fast-forward

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants