New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Performance improvements to `utils.softmax` #6113

Merged

rusty1s merged 2 commits into master from softmad

Dec 1, 2022

Member

rusty1s commented Dec 1, 2022

Use utils.scatter for optimized scatter_max implementation
Do not require gradients for offset computation


          update

rusty1s self-assigned this

rusty1s added feature 0 - Priority P0 benchmark utils labels

github-actions bot removed the benchmark label


          changelog

b9a246b

rusty1s merged commit 07ba384 into master

rusty1s deleted the softmad branch

December 1, 2022 12:13

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment