Skip to content

Issues: pytorch/torchtune

v0.4.0 release tracker
#1747 opened Oct 2, 2024 by joecummings
Open 3
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

192 Open 495 Closed
192 Open 495 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

implement activation offloading and opt_in_bwd in knowledge_distillation recipes community help wanted We would love the community's help completing this issue
#1959 opened Nov 7, 2024 by felipemello1
LLAMA-3-2 11b Vision Instruct
#1957 opened Nov 6, 2024 by Praveen-mvp
1
Remove beautiful hack in Github workflow now that PyArrow has release v18 best practice Things we should be doing but aren't
#1947 opened Nov 4, 2024 by joecummings
LoRA enabling question? question Further information is requested
#1935 opened Oct 31, 2024 by kailashg26
1
Pretraining Cuda Out of Memory Issue
#1932 opened Oct 31, 2024 by muniefht
6
investigate compile flag in flex attention better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1926 opened Oct 30, 2024 by felipemello1
1
How to finetune custom models?
#1925 opened Oct 30, 2024 by nam1410
2
Make ModelTokenizer a Transform better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1922 opened Oct 30, 2024 by RdoubleA
[docs] Fix custom message transform example community help wanted We would love the community's help completing this issue documentation Improvements or additions to documentation
#1919 opened Oct 29, 2024 by RdoubleA
Rename knowledge distillation recipe to lora_knowledge_distillation_single_device better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1906 opened Oct 25, 2024 by SalmanMohammadi
@SalmanMohammadi
Support for activation offloading pre-fetching? question Further information is requested
#1905 opened Oct 25, 2024 by shuy98
@joecummings @janeyx99
1
[Feature] Support additional trainable layers during LoRA fine-tuning enhancement New feature or request
#1901 opened Oct 24, 2024 by ebsmothers
4
Removing extra checks for logging memory in recipes better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs community help wanted We would love the community's help completing this issue
#1900 opened Oct 24, 2024 by SalmanMohammadi
@SalmanMohammadi
[Cleanup] Delete FSDP1 code community help wanted We would love the community's help completing this issue
#1897 opened Oct 24, 2024 by ebsmothers
8 tasks
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
14 tasks
Custom reference model for DPO recipes
#1888 opened Oct 23, 2024 by krammnic
Better testing for eval recipe: add test for generation and log likelihood tasks better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs
#1873 opened Oct 20, 2024 by SalmanMohammadi
@SalmanMohammadi
Mask construction & attention dispatch issues and possible ideas to allow for more models discussion Start a discussion
#1870 opened Oct 19, 2024 by mirceamironenco
"Get Started" Documentation Doesn't Work bug Something isn't working documentation Improvements or additions to documentation
#1869 opened Oct 19, 2024 by lhl
@joecummings
1
Separate ToMessages transforms for text+image better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs discussion Start a discussion
#1862 opened Oct 17, 2024 by RdoubleA
6
Remove PyTorch 2.5.0 checks better engineering Tasks which help improve eng productivity e.g. building tools, cleaning up code, writing docs community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#1861 opened Oct 17, 2024 by RdoubleA
7 tasks
@JP-sDEV
3
using Torchtune to teach LLMs a new language question Further information is requested
#1859 opened Oct 17, 2024 by almugabo
3
MM dataset docs nits documentation Improvements or additions to documentation
#1858 opened Oct 17, 2024 by SalmanMohammadi
@pbontrager
CUDA error with <bitsandbytes.optim.PagedAdamW> optimzier
#1856 opened Oct 17, 2024 by shawnricecake
2
[RFC] Kaggle Model Hub Integration for Torchtune rfc Request for comments
#1852 opened Oct 16, 2024 by KeijiBranshi
@joecummings
20
ProTip! What’s not been updated in a month: updated:<2024-10-06.