Skip to content

Godzilla v0.3.5: --kv-vram-only Support

Choose a tag to compare

View all tags
@atomicmilkshake atomicmilkshake released this 22 Jul 18:09
v0.3.5
03ac384

Godzilla v0.3.5 Release Notes

  • feat(kv): Added --kv-vram-only flag to force GPU KV cache allocation even when model weights are primarily in System RAM (-ngl 0/1).
  • build: Rebuilt with MSVC 19.51 and CUDA 13.2 for RTX 3080 / 4090 architectures.
  • compat: Full integration with VandelayNexus Hotrod Matrix optimization suite.
Assets 2
Loading