Skip to content

Commit

Permalink
ugh didn't notice this tiny rebasing mistake, introduced a bug. good …
Browse files Browse the repository at this point in the history
…candidate for a CI that we can overfit a single batch in the train_gpt2.cu script and get the exact same numbers as we expect in the test_gpt2.cu file
  • Loading branch information
karpathy committed May 2, 2024
1 parent 2c79600 commit 6ebef46
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion train_gpt2.cu
Original file line number Diff line number Diff line change
Expand Up @@ -2761,7 +2761,6 @@ int main(int argc, char *argv[]) {
// if we're overfitting a single batch, we'll only call this at step = 0
dataloader_next_batch(&train_loader);
}
dataloader_next_batch(&train_loader);
gpt2_forward(&model, train_loader.inputs, train_loader.targets, B, T);
gpt2_zero_grad(&model);
gpt2_backward(&model);
Expand Down

0 comments on commit 6ebef46

Please sign in to comment.