Skip to content

v2.4.1: safer model downloads

Choose a tag to compare

View all tags
@harshit-genrius harshit-genrius released this 25 Oct 13:04
· 11 commits to main since this release
v2.4.1
18c5ca3

Fixes #2: the one-click launchers no longer reuse a model part that only partly downloaded.

What changed

  • run_qwen3_4b.bat, run_llama31_8b.bat and run.sh now download each model part to <name>.part and rename it only after the download has finished.
  • Each part is checked against its byte count and sha256 as published on Hugging Face before it is used.
  • A part on disk with the wrong size (for example after a closed window, Ctrl+C or a network drop) is deleted and downloaded again, with a message that says so. A failed check is retried up to 3 times.
  • Same commands as before. Model URLs, env.bat and the llama-server command line are unchanged.

What did not change

  • The models are unchanged: same files, sizes and sha256 on Hugging Face. If you already have complete model files in models, they are kept and not downloaded again.
  • The binaries and libraries in both archives are byte-identical to v2.4-oneclick; only the launcher scripts were replaced.

Windows: download pingala8-windows-cuda12.zip, unzip, double-click run_qwen3_4b.bat (or run_llama31_8b.bat). The first run downloads the model from Hugging Face; then a chat page opens at http://127.0.0.1:8080.

Linux: download pingala8-linux-cuda13.tar.gz, extract, run ./run.sh qwen (or ./run.sh llama), open http://127.0.0.1:8080.

Needs an NVIDIA GPU (RTX 30, 40 or 50 series) and a recent driver.

Demo video and poster (from v2.4-oneclick):

Paper: https://doi.org/10.5281/zenodo.23481757
Models: https://huggingface.co/Genrius-AI/Qwen3-4B-Pingala8-2bit and https://huggingface.co/Genrius-AI/Llama-3.1-8B-Pingala8-2bit (Built with Llama)

Assets 4
Loading