Skip to content

v0.10.0

Latest

Choose a tag to compare

@github-actions github-actions released this 08 Nov 12:08

Metalhead v0.10.0

Diff since v0.9.8

Metalhead 0.10 ports models of the Hugging Face Hub to Flux: the vision models of timm, language models of transformers, text-to-image pipelines of diffusers and text embeddings of sentence-transformers. They load the original safetensors weights by name through create_model, and are checked numerically against PyTorch.

Breaking changes

  • Flux 0.16.14, NNlib 0.9.57 and MLUtils 0.4.9 are now the minimum versions.
  • The hand-written models of 0.9 (ResNet(50), ViT(:base), ...) and their lowercase builders, backbone, classifier, Metalhead.loadpretrain!, the Metalhead.Layers module and pretrain = true are deprecated, with a warning once per session, and will be removed in 0.11. The migration guide gives their create_model replacements.

See the changelog for the full list of changes.

🧔‍♂️🤖 Assisted by AI

Merged pull requests:

Closed issues:

  • ResNet model takes forever to load in Metalhead 0.8 compared to 0.7. (#247)
  • Roadmap: Hugging Face model ports beyond v0.10 (#304)
  • Release 0.10.0, then remove the legacy dependencies in 0.11 (#315)
  • Pre-release review of 0.10.0 (#342)
  • Model configurations drop unknown keys silently (#367)