Skip to content

Issues: arcee-ai/mergekit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

127 Open 123 Closed
127 Open 123 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Thera are still some problems with moe merge qwen with other LLM(like llama,deepseek,etc)
#361 opened Jul 3, 2024 by aoyinke
Condense a models layers.
#360 opened Jul 1, 2024 by DewEfresh
Support of BitNet
#356 opened Jun 25, 2024 by Ttimofeyka
About the merging method used for Arcee-Spark
#355 opened Jun 24, 2024 by daiquocnguyen
Sincerely.. I have no words...without insulting someone.
#353 opened Jun 17, 2024 by 0wwafa
2
MOE models that based on Gemma cannot work
#352 opened Jun 17, 2024 by pharaohcaptain
2
New method: MAP:Low-compute Model Merging with Amortized Pareto Fronts via Quadratic Approximation
#351 opened Jun 16, 2024 by duyvuleo
pass eval arguments directly in mergekit-evo
#349 opened Jun 13, 2024 by johnwee1
New merge method / algorithm proposal: Geometric Median and TGMD merge
#345 opened Jun 11, 2024 by 6DammK9
How to merge specific parameters
#344 opened Jun 10, 2024 by qhz991029
ValueError: operands could not be broadcast together with shapes (8192,28672) (8192,24576)
#343 opened Jun 8, 2024 by ashmalvayani
1
Need some help in merging same architectures, but with different tokens in their tokenizers
#342 opened Jun 7, 2024 by choprahetarth
4
Evolutionary Merging out of memory
#341 opened Jun 4, 2024 by ArcherShirou
3
Use logscale for operations dealing with norm layers?
#339 opened Jun 2, 2024 by jukofyork
parameters: int8_mask: true ??
#338 opened Jun 1, 2024 by David-AU-github
1
Support for microsoft/Phi-3-vision-128k-instruct
#337 opened Jun 1, 2024 by AshD
Questions about density gradient and weight gradient in Ties example
#336 opened May 31, 2024 by zhang-tuo-pdf
Does this run single core?
#329 opened May 25, 2024 by Autumnlight02
2
extract_lora.py can't handle mismatched lm_head tensor due to added tokens
#328 opened May 24, 2024 by jukofyork
10
how to merge for different rope scaling?
#325 opened May 21, 2024 by sangmandu
3
Merging models with different structures in linear
#324 opened May 20, 2024 by HawkClaws
2
Relax dependency versions
#321 opened May 14, 2024 by Nugine
Merge of hidden_size
#320 opened May 14, 2024 by win10ogod
How to merge a VLM and LLM with different model type.
#319 opened May 13, 2024 by tanyakansal30
Add support for subfolder loading
#318 opened May 13, 2024 by xzuyn
ProTip! Follow long discussions with comments:>50.