Skip to content

Issues: CarperAI/trlx

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

71 Open 211 Closed
71 Open 211 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

TRLX Environment customization
#593 opened Apr 21, 2024 by heraldiclily
Issue of tensors share memory bug Something isn't working
#591 opened Apr 1, 2024 by heraldiclily
1
[New Feature Request] Add KTO feature request New feature or request
#590 opened Jan 27, 2024 by 1485840691-eng
RLHF text summarization diverges bug Something isn't working
#589 opened Jan 14, 2024 by AlisonWen
Integration of Self-Play Fine-Tuning (SPIN) Method for Enhancing Large Language Models feature request New feature or request
#588 opened Jan 11, 2024 by SeungyounShin
Runtime error when running examples (ilql_sentiments_t5.py) bug Something isn't working
#587 opened Jan 8, 2024 by youxiho1
2
MPT is not working bug Something isn't working
#585 opened Dec 12, 2023 by ouhenio
when i use trlx ppotrainer train a model llama 13b model, but saved huggingface mode ,but when it inference , it has some strange keys ,and the inference result did not show ,it also have no error , it seems the result disapper bug Something isn't working
#584 opened Dec 3, 2023 by ldh127
1
Attention mask when calculating log ratio for PPO
#582 opened Nov 23, 2023 by kmy17518
Multi-GPU training errors with peft bug Something isn't working
#581 opened Nov 20, 2023 by AliengirlLiv
Issue since most recent transformers update bug Something isn't working
#580 opened Nov 11, 2023 by siddharthverma314
multigpu support for summarization ppo example bug Something isn't working
#571 opened Oct 21, 2023 by sayan1101
3
Problem with LLama training with LoRA bug Something isn't working
#567 opened Oct 17, 2023 by freQuensy23-coder
3
Question about saving peft checkpoint bug Something isn't working
#565 opened Oct 13, 2023 by nhanph
2
How to generate reward-labeled dataset feature request New feature or request
#561 opened Sep 20, 2023 by mikkelmedm
How to train LLaMA2 on the summarize_rlhf example?
#559 opened Sep 12, 2023 by missflash
Increasing max new tokens for generation arguments lead to errors bug Something isn't working
#553 opened Sep 4, 2023 by wise-east
3
Memory occupy with multi GPUs Training
#548 opened Aug 22, 2023 by yuanyaaa
1
ILQL training batch2 tensor dimensions error
#540 opened Jul 27, 2023 by GenVr
2
Add support for Falcon 7B/40B feature request New feature or request
#532 opened Jul 19, 2023 by cvetanovskaa
1
Implement Asynchronous PPO feature request New feature or request
#531 opened Jul 18, 2023 by Dahoas
ppo using GLM2-6b as a backbone? feature request New feature or request
#523 opened Jul 17, 2023 by fanxinyun1991
1
support base model + multi adapter for actor, critic, ref and reward model feature request New feature or request
#518 opened Jul 7, 2023 by akk-123
8-bit inference bug Something isn't working
#512 opened Jun 24, 2023 by glerzing
Add support for safetensors feature request New feature or request
#505 opened Jun 14, 2023 by glerzing
ProTip! Updated in the last three days: updated:>2024-05-12.