Skip to content

Issues: huggingface/trl

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

52 Open 920 Closed
52 Open 920 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Optimizing an LLM Using DPO: nan Loss Values During Evaluation
#1789 opened Jun 29, 2024 by Refinath
Lora seems to be invalid when using vsft_llava.py
#1786 opened Jun 28, 2024 by shijian2001
3
Error with SFT of LLaVA-Next
#1785 opened Jun 28, 2024 by GohioAC
Supports of SFTTrainer / PPOTrainer / DPOTrainer for LLaVA-alike model
#1784 opened Jun 27, 2024 by fangkuoyu
1
Clarification on reward/value heads in PPOV2
#1783 opened Jun 27, 2024 by SalmanMohammadi
3
Conflict in start index under batched_forward_pass
#1781 opened Jun 27, 2024 by mertsayar8
The DPO 'grad_norm': 0.0,
#1778 opened Jun 27, 2024 by Faded1022
DDPO trained model error when used to generate images
#1775 opened Jun 26, 2024 by nguyenhoa-uit
1
Want to use zero3 to train KTO and met error
#1770 opened Jun 25, 2024 by Faded1022
Can bert be used for dpo training?
#1768 opened Jun 24, 2024 by anyuese
SFTTrainer device error even though it doesn't take device as an argument
#1767 opened Jun 24, 2024 by zyzhang1130
Neftune is applied twice; in trl and transformers BOTH!
#1766 opened Jun 24, 2024 by MilkClouds
1
Using IterableDataset crashed the SFTTrainer
#1764 opened Jun 23, 2024 by helloworld1
1
DataCollatorForCompletionOnlyLM does not work with FSDP
#1756 opened Jun 20, 2024 by aabhasgupta
Misuse of gen_len in examples/notebooks/gpt2-sentiment.ipynb
#1755 opened Jun 19, 2024 by MercuryDemo
1
Question about apply_chat_template in examples
#1752 opened Jun 18, 2024 by EganGu
7
[BUG] TRL CLI not capturing torch_dtype correctly
#1751 opened Jun 17, 2024 by alvarobartt
1
[DOCS] Some headers (h2, h3) not rendered properly
#1745 opened Jun 17, 2024 by alvarobartt
TypeError: IterableDataset.map() got an unexpected keyword argument 'num_proc' with streaming datasets
#1741 opened Jun 15, 2024 by mrbesher
1
DPOTrainer: AttributeError: 'list' object has no attribute 'numel'
#1737 opened Jun 14, 2024 by tahirahmad2030
2
[BUG] RuntimeError: still have inflight params in KTO
#1732 opened Jun 13, 2024 by iszengxin
FSDP with PPO trainer won't work because FSDP doesn't support model.generate
#1726 opened Jun 12, 2024 by artkpv
7
FSDP Must flatten tensors with uniform dtype but got torch.bfloat16 and torch.float32
#1723 opened Jun 11, 2024 by qZhang88
3
KTO train_loss = 0.0
#1722 opened Jun 10, 2024 by yaoxiao1999
11
Distributed fine-tuning using KTO, QLorA and FSDP throws ValueError You cannot perform fine-tuning on purely quantized models...
#1719 opened Jun 9, 2024 by nubloso
1
ProTip! Adding no:label will show everything without a label.