Search results

Integrate ModernBERT Support into Mergoo

Status: Open.

#25 In Leeroo-AI/mergoo;

· giacomofrisoni opened on Jan 30, 2025

What are the versions of ‘transformers’ and ‘peft’?

Status: Open.

#24 In Leeroo-AI/mergoo;

· yuezhitangxi opened on Dec 25, 2024

Why does transformers==4.18.0 but still get this error, cannot import name ‘id_tensor_storage’ from ‘transformers.pytorch_utils’. What do I need to do?

Status: Open.

#23 In Leeroo-AI/mergoo;

· yuezhitangxi opened on Dec 23, 2024

Could I make just in time for defect prediction（one of the text classification tasks） with lora-moe?

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#22 In Leeroo-AI/mergoo;

· chhh745 opened on Nov 6, 2024

ValueError: <code>rope_scaling</code>'s type field must be one of ['su', 'yarn'], got longrope

enhancementNew feature or requestNew feature or request

Status: Open.

#21 In Leeroo-AI/mergoo;

· jzyee opened on Aug 31, 2024

Could model_type support QWEN models?

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#19 In Leeroo-AI/mergoo;

· AllenShow opened on Jul 8, 2024

Add shortcut for MLP hidden state computation.

enhancementNew feature or requestNew feature or request

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#18 In Leeroo-AI/mergoo;

· jacklanda opened on Jun 14, 2024

[Feature] Support New Arguments for Expert Routing Policies.

enhancementNew feature or requestNew feature or request

Status: Open.

#17 In Leeroo-AI/mergoo;

· jacklanda opened on May 31, 2024

LoRA MoE with k_proj, up_proj, down_proj

bugSomething isn't workingSomething isn't working

Status: Open.

#13 In Leeroo-AI/mergoo;

· aksh555 opened on May 12, 2024

It will be a good idea to support T5 series model.

enhancementNew feature or requestNew feature or request

Status: Open.

#12 In Leeroo-AI/mergoo;

· svjack opened on May 8, 2024