Skip to content

Issues: huggingface/nanotron

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

30 Open 28 Closed
30 Open 28 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add Debug utility to be able to preview first samples used for training good first issue Good for newcomers help wanted Extra attention is needed
#184 opened May 27, 2024 by NouamaneTazi
PyTorch profiler is unable to serialize numpy datatypes sometimes inserted as process group ranks
#177 opened May 22, 2024 by hatanp
"datatrove" is missing from the examples folder
#175 opened May 20, 2024 by RonanKMcGovern
We don't save checkpoint after training ends good first issue Good for newcomers help wanted Extra attention is needed Low Priority
#163 opened May 6, 2024 by NouamaneTazi
out of memory for continuing pretraining llama3-8B
#161 opened May 3, 2024 by ckzbullbullet
5
moe in src and load balancing losses
#159 opened May 2, 2024 by haeggee
Add data loading time in log
#154 opened Apr 26, 2024 by XinDongol
Make Pipeline Parallelism Optional
#153 opened Apr 25, 2024 by XinDongol
1
FEAT: Support 1.58-bit LLMs training enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed Low Priority
#114 opened Mar 21, 2024 by younesbelkada
1
[Features] support gradient checkpointing for memory saving
#99 opened Mar 5, 2024 by zguo0525
1
[Feature] All GPUs within the same TP group load training data from shared memory enhancement New feature or request help wanted Extra attention is needed Low Priority
#91 opened Mar 3, 2024 by xrsrke
[Unit Test] Add unit tests for DistributedTrainer good first issue Good for newcomers help wanted Extra attention is needed High Priority
#90 opened Mar 2, 2024 by xrsrke
5
[Unit Test] Add unit test for DoReMi's trainer Medium Priority
#89 opened Mar 2, 2024 by xrsrke
@xrsrke
[Feature] Use CUDA event for measuring elasped time enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#88 opened Mar 2, 2024 by xrsrke
[Feature] Asyncronous Serialization enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#87 opened Mar 2, 2024 by xrsrke
[Feature] Kernel Fusion of Layer Norm and GeLU enhancement New feature or request help wanted Extra attention is needed
#86 opened Mar 2, 2024 by xrsrke
[Feature] LAMB optimizer enhancement New feature or request help wanted Extra attention is needed
#85 opened Mar 2, 2024 by xrsrke
[Feature] Parallel transformer block enhancement New feature or request help wanted Extra attention is needed High Priority
#84 opened Mar 2, 2024 by xrsrke
@xrsrke
Continued Pretraining on Llama 7b.
#79 opened Feb 23, 2024 by wiseyy
5
[Feature] Refactor ParallelContext.world_rank_matrix enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
#77 opened Feb 19, 2024 by NouamaneTazi
[Feature] Fix support for sequence parallelism with MoEs enhancement New feature or request help wanted Extra attention is needed
#74 opened Feb 16, 2024 by NouamaneTazi
[Feature request] Performance and accuracy benchmarks
#61 opened Feb 9, 2024 by brianyu-nexusflowai
2
[Question] Modification for Performing Fine-Tuning
#57 opened Feb 5, 2024 by allanj
3
[Question] Async Tensor Parallel
#48 opened Jan 27, 2024 by woshiyyya
2
[Question] Correctness of backward pass of RowLinear
#46 opened Jan 26, 2024 by ufotalent
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.