Should we publish public fused GGUF / Ollama weights? #11
YauhenBichel
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Context
The GitHub repo is the source of truth for code + harness. Weights are meant to live on Hugging Face: YauhenBichel/python-vibe-0.5b.
A 400-iter MLX QLoRA run overfit after ~step 100 (val ~0.91 then ~1.63 at 400). Shipping a fused 4-bit blob of the last checkpoint would freeze a worse model than the mid-run adapter.
Questions
ollama pullworks without MLX?Constraints we will not drop: no real keys in the card, no
curl|shexamples, Apache-2.0 on the code.Comment with what you would actually download and run.
All reactions