Skip to content

T-G2 — Automatic unloading #321

Description

@lightningpixel

Epic: Epic G — VRAM pre-flight & job queue
Priority: P2

Context

unload_models already exists as an agent tool, but stays entirely manual — the user (or the LLM) has to remember to call it.

Scope

  • Make unload_models systematic: offer it (or auto-unload based on a setting) before a launch that would exceed free VRAM.

Acceptance criteria

Chaining two generations with different models no longer requires manual unloading.

Depends on: T-G1


From ROADMAP_0.5.md.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions