Repository navigation
MeteorLLM v0.2.1
Vita runtime
The same 67-token Tavi benchmark finished in 37.14 seconds with the template ready, down from 39.00 seconds in v0.2.0. First token arrived in 28.18 seconds. Both runs returned Tavi. with token IDs 51, 6190, 13 and natural EOS.
Only the 32 shared chat-template tokens were cached. Preparing them took 20.80 seconds at startup. Template preparation plus the measured response took 57.94 seconds, excluding model load. The benchmark covers one prompt. See the README for the configuration, output tradeoffs, and overrides.
Install
Install the VPK over v0.2.0 and keep your existing model files. On a fresh setup, follow the README and get the compatible Q4 output archive from v0.2.0. The same output file enables the faster path in this release.