Skip to content

Pull requests: karpathy/llm.c

New pull request New
62 Open 312 Closed
62 Open 312 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Remove redundant CPU computation in encoder bwd
#512 opened Jun 1, 2024 by gordicaleksa Loading…
Benchmark modal script revamped - profiling and external libraries (Issue #504)
#510 opened Jun 1, 2024 by vyom1611 Loading…
adding wsd schedule with (1-sqrt) decay
#508 opened Jun 1, 2024 by eliebak Loading…
1
Added script to download all of the tokenized fineweb100B data from huggingface
#507 opened May 31, 2024 by ChrisDryden • Draft
3
Added additional layernorm forward kernel that does not recalculate mean and rstd
#506 opened May 31, 2024 by ChrisDryden Loading…
Added constexpr for blocksizes to optimize compilation
#505 opened May 31, 2024 by ChrisDryden Loading…
Add DockerFile
#501 opened May 30, 2024 by banyan-god Loading…
Realtime training visualization using wandb
#489 opened May 29, 2024 by chinthysl Loading…
6
MFU for other GPUs
#486 opened May 28, 2024 by ngc92 Loading…
3
Trigger CI template
#483 opened May 28, 2024 by rosslwheeler Loading…
Added kernel development file for permute_backwards
#477 opened May 27, 2024 by ChrisDryden Loading…
1
[WIP - Fix] Add assert for layernorm kernel 8
#472 opened May 27, 2024 by lancerts • Draft
5
train_gpt2.c: Add gpt2_write_to_checkpoint method
#467 opened May 26, 2024 by faxe1008 Loading…
.gitignore: ignore more for windows devs
#466 opened May 26, 2024 by nietras Loading…
test_gpt2.c: detailed timings
#465 opened May 26, 2024 by nietras Loading…
1
Fix MSVC compilation error with openMP
#460 opened May 25, 2024 by avflyer Loading…
7
Added new cuda kernel for encoder forwards using three dimensional kernels
#459 opened May 25, 2024 by ChrisDryden Loading…
1
Add cmake and fix OMP
#452 opened May 23, 2024 by avflyer Loading…
3
move all kernels into a dedicated cuda stream
#448 opened May 22, 2024 by ngc92 • Draft
Use proper GeLU on CPU
#441 opened May 21, 2024 by jart Loading…
3
Added warpsize as a constant expr for dev/cuda files
#438 opened May 20, 2024 by lancerts Loading…
1
only save missing bits to reconstruct fp32 master weights
#432 opened May 19, 2024 by ngc92 Loading…
weight reordering: attempt 1
#427 opened May 17, 2024 by ngc92 • Draft
NCCL only multi gpu training for slurm enabled cluster
#426 opened May 17, 2024 by chinthysl Loading…
10
vectorized gemm loading and use register to hold the intermediate value
#424 opened May 17, 2024 by patricxu Loading…
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.