SillyTavern Background Generation Queue

Server plugin + UI extension pair for SillyTavern that keeps supported streaming generations running on the server so a browser tab can reconnect later.

GitHub: https://github.com/ColorSource/SillyTavern-BackgroundGenerationQueue

What this solves

• The browser page can disconnect while a supported generation is still running.
• The generation continues on the SillyTavern server instead of dying with the tab.
• When the page comes back, the extension can reconnect to the live stream and continue updating the message.

Repository layout

• server-plugin/ - the Node-side server plugin
• extension/ - the UI extension that hooks SillyTavern's streaming fetches
• scripts/install.mjs - copies both parts into a SillyTavern install
• scripts/uninstall.mjs - removes the installed plugin and extension

Supported scope

• Backends: Chat Completions, Text Completions, Kobold, NovelAI
• Flow: one-on-one normal streaming replies

Not covered yet

• Group generations
• Swipe/regenerate/continue parity
• Quiet prompts
• Long-term persistence beyond in-memory job storage

Install

Full install

1. Clone or unpack this repository.
2. Run:

node scripts/install.mjs --st "/path/to/SillyTavern"

3. Make sure enableServerPlugins: true is set in your SillyTavern config.yaml.
4. Restart SillyTavern.
5. In SillyTavern, open Extensions and enable Background Generation Queue.

Install from SillyTavern's extension importer

You can now import this repository URL directly as a third-party extension because the repository root includes a valid manifest.json.

Repository URL:

https://github.com/ColorSource/SillyTavern-BackgroundGenerationQueue

Important: that importer only installs the UI extension part. You still need the server plugin for background generation to actually work. After importing the extension, either:

• run node scripts/install.mjs --st "/path/to/SillyTavern", or
• manually copy server-plugin/ to plugins/background-generation-queue/

Uninstall

node scripts/uninstall.mjs --st "/path/to/SillyTavern"

Manual install

• Copy server-plugin/ to plugins/background-generation-queue/ inside SillyTavern
• Copy manifest.json, index.js, and extension/ to public/scripts/extensions/third-party/background-generation-queue/ inside SillyTavern

Slash command

• /bgqueue status
• /bgqueue on
• /bgqueue off
• /bgqueue resume
• /bgqueue cancel

Development check

npm run check

Notes

• This extension intentionally lives outside SillyTavern core, but it still depends on current internal streaming behavior and may need updates if upstream changes.
• Background jobs are kept in memory only and are cleaned up automatically.