Skip to content

TensorFold 0.3.1

Choose a tag to compare

View all tags
@ashhart ashhart released this 26 Sep 18:27
· 128 commits to main since this release
v0.3.1
d7470ed
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

TensorFold 0.3.1 says plainly when a checkpoint has no recipe, before anything downloads.

  • tensorfold info MODEL shows how a checkpoint stores its weights (MLX 4-bit, groups of 64, exl3 (4-bit), ...) and which backends read them.
  • serve and pull refuse a model type with no family, or weights no engine reads yet (EXL3, NVFP4, GPTQ, AWQ), and point to the recipe book and the runbook.
  • A checkpoint that isn't one TensorFold is tested with still runs when its format matches, with a note that its speed and quality are unmeasured.

Upgrade: pip install --upgrade git+https://github.com/ashhart/TensorFold.git@v0.3.1.

Assets 2
Loading