Skip to content

Issues: mlfoundations/open_lm

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

26 Open 33 Closed
26 Open 33 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Remote Sync FSSPEC cannot upload large checkpoints
#279 opened May 18, 2024 by Skylion007
samples_per_second_per_gpu or tokens_per_second_per_gpu?
#262 opened Apr 29, 2024 by Muennighoff
1
MoE Expert parallelism config
#251 opened Apr 15, 2024 by Muennighoff
Someone is using your project to sell it as a token
#247 opened Apr 12, 2024 by yzthink
1
Support user specified token pre-processing functions enhancement New feature or request good first issue Good for newcomers
#194 opened Jan 7, 2024 by sagadre
Factorize helper function for all model loading
#181 opened Dec 23, 2023 by sagadre
grad accum tests failing on gpu w/ amp_bf16 precision
#171 opened Dec 19, 2023 by sagadre
Undefined argument "moe_freq" when running unit tests on WSL/Ubuntu 20.04
#168 opened Dec 19, 2023 by aaronsm
@achalddave
1
--delete-previous-checkpoint should delete prev checkpoints in --remote-sync bucket good first issue Good for newcomers
#166 opened Dec 19, 2023 by sagadre
Error early if we don't have enough disk space good first issue Good for newcomers
#154 opened Dec 14, 2023 by achalddave
Investigate effect of FSDP policies on mamba speed
#144 opened Dec 9, 2023 by sagadre
Support saving/loading models larger than CPU memory
#130 opened Dec 4, 2023 by achalddave
Figure out why AdamW + gradient accumulation leads to different results for test case
#126 opened Nov 30, 2023 by achalddave
6
Move dummy cred download into test
#121 opened Nov 30, 2023 by achalddave
@Vaishaal
clean up model_configs directory
#116 opened Nov 27, 2023 by kernelmachine
@sagadre
Add venv cache for CI to avoid installing dependencies good first issue Good for newcomers
#104 opened Nov 21, 2023 by achalddave
open_lm chronicles enhancement New feature or request
#90 opened Nov 14, 2023 by iejMac
HF Integration enhancement New feature or request
#89 opened Nov 14, 2023 by sedrick-keh-tri
@sedrick-keh-tri
3
Minimize how often we load args.resume enhancement New feature or request good first issue Good for newcomers
#71 opened Nov 6, 2023 by achalddave
1
Tokenization on-the-fly without slowdown
#55 opened Oct 24, 2023 by sagadre
llama2 unit tests good first issue Good for newcomers
#52 opened Oct 22, 2023 by sagadre
Documentation: competing frameworks
#41 opened Oct 18, 2023 by borgr
2
fp8 training on h100s
#37 opened Oct 16, 2023 by mitchellnw
Weird memory usage for 11m vs 160m: similar batch size fits in memory...
#35 opened Oct 14, 2023 by alexjc
14
Benchmark tok/sec with other libs
#21 opened Sep 26, 2023 by kernelmachine
@achalddave
4
ProTip! Follow long discussions with comments:>50.