Fixes Colab free-tier failure caused by preinstalled incompatible torchao==0.10.0 interacting with PEFT. Annihilate now disables PEFT's optional torchao integration when torchao is too old.
Install or upgrade:
pip install -U annihilate-llm==1.3.9Fixes Colab free-tier failure caused by preinstalled incompatible torchao==0.10.0 interacting with PEFT. Annihilate now disables PEFT's optional torchao integration when torchao is too old.
Install or upgrade:
pip install -U annihilate-llm==1.3.9