Skip to content

Issues: AnswerDotAI/fsdp_qlora

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

27 Open 7 Closed
27 Open 7 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

train.py
#63 opened Apr 26, 2024 by mylesgoose
1
ValueError report
#61 opened Apr 25, 2024 by mxjmtxrm
Request for Scripts to Merge QDoRA Adapters with Base Model for vLLM Inference
#60 opened Apr 25, 2024 by iseesaw
4
Question about GPU memory usage.
#59 opened Apr 25, 2024 by mxjmtxrm
DeepSeek VL support
#58 opened Apr 24, 2024 by SinanAkkoyun
How does one load and do inference on fine-tuned LLama 3 using bnb_dora train script?
#57 opened Apr 24, 2024 by pe-hy
BOFT support?
#56 opened Apr 24, 2024 by Xynonners
Can i use this script to pre-train models?
#55 opened Apr 23, 2024 by brunocruzfranchi
llama3?
#53 opened Apr 19, 2024 by lianuo
Results after running
#50 opened Apr 16, 2024 by hsb1995
What if I have three graphics cards?
#49 opened Apr 11, 2024 by lianuo
1
How to load the saved model?
#48 opened Apr 9, 2024 by bilalghanem
process 0 terminated with signal SIGKILL
#47 opened Apr 9, 2024 by hsb1995
4
how to inference using 70b? or we need to implement it with the same way to train it by ourself?
#46 opened Apr 7, 2024 by yaohwang
1
nan when the input length is large
#45 opened Apr 6, 2024 by bilalghanem
5
Why is o_proj not targetted?
#44 opened Apr 5, 2024 by GRcharles
Question about adding / training Mixtral
#43 opened Apr 3, 2024 by chrismrutherford
1
Q on comparison with SFTTrainer
#42 opened Apr 1, 2024 by RonanKMcGovern
/opt/conda/conda-bld/pytorch_1708025847130/work/aten/src/ATen/native/cuda/Loss.cu:250: nll_loss_forward_reduce_cuda_kernel_2d: block: [0,0,0], thread: [14,0,0] Assertion t >= 0 && t < n_classes failed.
#40 opened Mar 29, 2024 by yaohwang
Bigger context size?
#38 opened Mar 26, 2024 by LoganALJones
train.py script crashes when using HQQ
#37 opened Mar 24, 2024 by rationalism
3
Torch Compile?
#34 opened Mar 19, 2024 by jzhang38
Adding NVMe SSDs to Enable and Accelerate 100B Model Fine-tuning on a Single GPU
#31 opened Mar 13, 2024 by Iron-Bound
Fine tuning only runs on CPU
#29 opened Mar 11, 2024 by diabeticpilot
4
bugs for fine-tune fsdp multinode
#26 opened Mar 11, 2024 by batman-do
1
ProTip! no:milestone will show everything without a milestone.