-
Notifications
You must be signed in to change notification settings - Fork 74
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add bf16 Support to Adam #134
Commits on Aug 2, 2023
-
modified: bmtrain/optim/adam.py
ycr0776 committedAug 2, 2023 Configuration menu - View commit details
-
Copy full SHA for 3210632 - Browse repository at this point
Copy the full SHA 3210632View commit details -
ycr0776 committed
Aug 2, 2023 Configuration menu - View commit details
-
Copy full SHA for 4e4d32a - Browse repository at this point
Copy the full SHA 4e4d32aView commit details -
modified: bmtrain/optim/_function.py
modified: bmtrain/optim/adam.py modified: bmtrain/optim/adam_offload.py modified: csrc/cuda/adam_cuda.cu modified: csrc/include/adam_cpu.hpp
ycr0776 committedAug 2, 2023 Configuration menu - View commit details
-
Copy full SHA for ef038ae - Browse repository at this point
Copy the full SHA ef038aeView commit details -
modified: bmtrain/optim/_function.py
modified: csrc/bind.cpp modified: csrc/cuda/adam_cuda.cu modified: csrc/include/adam_cpu.hpp modified: csrc/include/bind.hpp
Configuration menu - View commit details
-
Copy full SHA for a1e0e42 - Browse repository at this point
Copy the full SHA a1e0e42View commit details
Commits on Aug 3, 2023
-
modified: add bf16.h to csrc/cuda/cross_entropy.cu
modified: add bf16.h to csrc/cuda/has_inf_nan.cu modified: add bf16 support to bmtrain/optim/_function.py modified: add bf16 support to csrc/cuda/adam_cuda.cu(Todo) modified: add bf16.h to csrc/cuda/reduce.cuh modified: add bf16 support to csrc/include/adam_cpu.hpp
Configuration menu - View commit details
-
Copy full SHA for efe3cdc - Browse repository at this point
Copy the full SHA efe3cdcView commit details -
modified: bmtrain/optim/_function.py
modified: csrc/cuda/adam_cuda.cu modified: csrc/cuda/reduce.cuh modified: csrc/include/adam_cpu.hpp
Configuration menu - View commit details
-
Copy full SHA for 6125f39 - Browse repository at this point
Copy the full SHA 6125f39View commit details -
Configuration menu - View commit details
-
Copy full SHA for e2fdcc5 - Browse repository at this point
Copy the full SHA e2fdcc5View commit details -
Configuration menu - View commit details
-
Copy full SHA for 00eee39 - Browse repository at this point
Copy the full SHA 00eee39View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2eb6d72 - Browse repository at this point
Copy the full SHA 2eb6d72View commit details
Commits on Aug 7, 2023
-
modified: bmtrain/loss/_function.py
modified: bmtrain/optim/optim_manager.py modified: csrc/bind.cpp modified: csrc/cuda/has_inf_nan.cu modified: csrc/include/adam_cpu.hpp new file: csrc/include/test.cpp
Configuration menu - View commit details
-
Copy full SHA for 6dfd739 - Browse repository at this point
Copy the full SHA 6dfd739View commit details -
modified: add bf16 to is_nan_inf()
modified: bind bf16 functions modified: revise the logic of bf16 accum modified: add bf16 to is_nan_inf() of CUDA version modified: revise the logic of bf16 accum modified: bind bf16 functions deleted: csrc/include/test.cpp
Configuration menu - View commit details
-
Copy full SHA for 8a6f686 - Browse repository at this point
Copy the full SHA 8a6f686View commit details -
modified: revise logic of has_inf_nan.cu FIX:csrc/include/adam_cpu.hpp FIX:csrc/include/bind.hpp
Configuration menu - View commit details
-
Copy full SHA for 0b22ed1 - Browse repository at this point
Copy the full SHA 0b22ed1View commit details -
modified: tests/test_has_inf_nan.py
new file: tests/test_has_inf_nan_bf16.py
Configuration menu - View commit details
-
Copy full SHA for f8885cf - Browse repository at this point
Copy the full SHA f8885cfView commit details -
modified: bmtrain/optim/_function.py
modified: csrc/bind.cpp new file: tests/test_optim_bf16.py new file: tests/test_optim_fp16.py
Configuration menu - View commit details
-
Copy full SHA for 9a9d526 - Browse repository at this point
Copy the full SHA 9a9d526View commit details -
Configuration menu - View commit details
-
Copy full SHA for 77c3585 - Browse repository at this point
Copy the full SHA 77c3585View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5cc3611 - Browse repository at this point
Copy the full SHA 5cc3611View commit details
Commits on Aug 8, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 870c613 - Browse repository at this point
Copy the full SHA 870c613View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2b414b8 - Browse repository at this point
Copy the full SHA 2b414b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 40441f8 - Browse repository at this point
Copy the full SHA 40441f8View commit details
Commits on Aug 9, 2023
-
Configuration menu - View commit details
-
Copy full SHA for c5f7e49 - Browse repository at this point
Copy the full SHA c5f7e49View commit details -
Configuration menu - View commit details
-
Copy full SHA for 148ed85 - Browse repository at this point
Copy the full SHA 148ed85View commit details