Repository navigation
v0.12.0
·
515 commits
to master
since this release
A cold-start release. Opt in and a quantized model's second cold load
skips the bf16 read and the quantize: MiniMax H3 loads in 19 s instead of
113 s on an RTX 3090. The caches that build up on a server's disk now have
a page, and the music-video cut planner stops treating Whisper's
hallucinations as lyrics.
Quantized-component cache (#815, #825, #826, #827)
DW_QUANTIZED_CACHE=1keeps each SDNQ on-the-fly-quantized component on
disk (safetensors plus JSON, under<HF_HOME>/dw-quantizedor
DW_QUANTIZED_CACHE_DIR) and reads it back on the next load of the same
key. Measured on an RTX 3090: H3 cold 112.7 s -> 18.7 s, warm 67.5 s ->
4.0 s. An H3 configuration holds about 43 GB.- It covers a modular pipeline's
load_components(H3) and a component
loaded on its own throughfrom_pretrained(LTX-2.5's transformer and
its Gemma text encoder, saved under their own tensor names so they load
back). A hit is placed on the config'sreturn_device. - The key pins the snapshot commit, the quantizer config and the sdnq,
diffusers, transformers and torch versions; a save is refused when it
would leave less thanmin(50 GiB, 10%)free, and aquantized_cache
job event names every hit, miss, save and skip with its reason. The cache
never fails a job. Off by default; docs/QUANTIZATION.md has the details.
Disk caches (#828, #832, #833, #834, #837)
GET /api/cacheslists dw's caches of derived data -inductor
(torch.compilekernels),triton(SDNQ's jit and autotune kernels)
andquantized- with size, files, last use and the volume's free
space;DELETE /api/caches/{name}clears one, refused while a job runs
or a download is active. The quantized cache lists its entries and
DELETE /api/caches/quantized/entries/{id}removes one.- The web UI's Server page has a Caches panel for the same, asking before
a clear and quoting what the clear costs.get_server_infocarries the
list for an agent.
Transcription and cuts (#822, #823)
music-video-cutstranscribes the vocal stem rather than the full mix,
so an instrumental intro no longer folds into the first word. Chunks
that are silent, overlong, wordless or a repetition loop are marked
suspect;plan_cutsleaves them out and warns once per run.get_gallery_metadata's envelope takesinterval_seconds(0.05 to
3600, default 1.0) so an agent can place a cut to a frame. More than
2400 bins is refused unless the default interval would give more.
Fixes
- The inherited cost estimate is withheld when an inline workflow runs
more steps or frames than the template it came from, instead of
quoting the template's number (#821: a 7x under-quote). assess_outputshot findings carryindexandstart_frame, so a
repeated shot name is unambiguous (#835).dialogue-shortandmusic-videoexposematch_levels_dbfs(#836).- A default cache root that appears after the server starts is marked,
sotritonstays clearable after the first run (#837). deploy.shrestarts adw.serverun as a loaded launchd daemon on
macOS.- A component's
attention_backendpin stays on that component. diffusers
also made it the process-wide default, so after an H3 run with
attention_backend=sage_hubthe worker sent every later model through
sage, and Music3 failed withUnsupported head_dim: 256(LTX's attention
mask is refused the same way). Music3 and LTX templates need no pin of
their own.