Skip to content

0.3.1 - Release

Choose a tag to compare

@ToldByNun ToldByNun released this 30 Aug 11:18
· 5 commits to main since this release
Handle Vulkan-safe KV and auto-install PyYAML

Switch Vulkan/HIP loads to F16 KV + disable flash-attn by default to avoid known AMD garbled-output bug; allow overrides via MANGO_VULKAN_ALLOW_QKV and MANGO_VULKAN_FLASH_ATTN. Add backend-aware GGUF loader and pass backend through ModelRunner with informative logs. Add automatic PyYAML import/auto-install helper for config load/save and ensure installer explicitly installs PyYAML; update installer smoke-test to import yaml. Add tests for Vulkan/HIP behavior and update docs. Affected: runtime/README.md, runtime/python/mango_runtime/{config.py,gguf_loader.py,model_runner.py,tests/test_config.py}, scripts/build-installer.ps1.