Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.
leaderboard
transformer
moe
mixture-of-experts
huggingface
slerp
large-language-models
llm
ties
mergekit
merge-llm
dare-ties
-
Updated
Feb 11, 2024 - Jupyter Notebook