Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat] Dropout(Activation(x+bias)), now with partial BW fusion #144

Closed
wants to merge 7 commits into from

Commits on Dec 16, 2021

  1. flipping the seeds so that it drops down from the top

    using less seeds
    
    tiling + vertical seeds
    
    Computing the FW and BW per tile over M
    
    workaround atomics, reintroduce locks, should not be too bad
    
    yet another take, partial sum
    
    better scheduling defaults, improves across the board
    
    giving atomic add a go
    
    back to the locks, completely fuse the BW
    blefaudeux committed Dec 16, 2021
    Configuration menu
    Copy the full SHA
    16808ea View commit details
    Browse the repository at this point in the history

Commits on Dec 18, 2021

  1. test fix and minor perf tweak, but would still be better to get rid o…

    …f the epilogue
    blefaudeux authored and Benjamin Lefaudeux committed Dec 18, 2021
    Configuration menu
    Copy the full SHA
    3cb49f3 View commit details
    Browse the repository at this point in the history
  2. flipping the bias buffer so that reduction is easier, still a perf pr…

    …oblem for small buffers and BW
    Benjamin Lefaudeux authored and blefaudeux committed Dec 18, 2021
    Configuration menu
    Copy the full SHA
    f1acb7a View commit details
    Browse the repository at this point in the history
  3. good enough perfs

    blefaudeux committed Dec 18, 2021
    Configuration menu
    Copy the full SHA
    93668d5 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    540b857 View commit details
    Browse the repository at this point in the history
  5. fix the stats issue

    blefaudeux committed Dec 18, 2021
    Configuration menu
    Copy the full SHA
    12705e8 View commit details
    Browse the repository at this point in the history

Commits on Dec 19, 2021

  1. Configuration menu
    Copy the full SHA
    ee9ea6f View commit details
    Browse the repository at this point in the history