Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Kernel] Add w8a8 CUTLASS kernels #4749

Merged
merged 20 commits into from
May 16, 2024
Merged

[Kernel] Add w8a8 CUTLASS kernels #4749

merged 20 commits into from
May 16, 2024

Commits on May 16, 2024

  1. Hopper Int and FP8 kernel for per tensor or per row/col

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    aa13b89 View commit details
    Browse the repository at this point in the history

  2. 2.x kernel for Ampere and Lovelace

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    d2fef83 View commit details
    Browse the repository at this point in the history

  3. Refactor, cleanup

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    24358c4 View commit details
    Browse the repository at this point in the history

  4. format

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    9e746c5 View commit details
    Browse the repository at this point in the history

  5. fixup

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    15c46ca View commit details
    Browse the repository at this point in the history

  6. fixup

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    73fe18a View commit details
    Browse the repository at this point in the history

  7. Only compile the cutlass kernel for sm90a. Saves 17 MB

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    2231691 View commit details
    Browse the repository at this point in the history

  8. add comment

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    a4c88df View commit details
    Browse the repository at this point in the history

  9. Optimizations for Ampere, scalar broadcast checks

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    47e95ad View commit details
    Browse the repository at this point in the history

  10. review comments

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    62a252b View commit details
    Browse the repository at this point in the history

  11. Support SM75 and fp16 output types

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    cdb8e06 View commit details
    Browse the repository at this point in the history

  12. format.sh

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    5be8af7 View commit details
    Browse the repository at this point in the history

  13. use cudaDeviceGetAttribute

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    ca43e2c View commit details
    Browse the repository at this point in the history

  14. Review comments

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    d09d973 View commit details
    Browse the repository at this point in the history

  15. fixups, cruft

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    9a07760 View commit details
    Browse the repository at this point in the history

  16. review comments

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    4909784 View commit details
    Browse the repository at this point in the history

  17. assert -> TORCH_CHECK

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    26f5890 View commit details
    Browse the repository at this point in the history

  18. Merge remote-tracking branch 'origin/upstream-main' into tms/w8a8_cut… 

    …lass_kernels
    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    ee1c11b View commit details
    Browse the repository at this point in the history

  19. format

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    39b838f View commit details
    Browse the repository at this point in the history

  20. Merge branch 'upstream-main' into tms/w8a8_cutlass_kernels

    @tlrmchlsmth
    tlrmchlsmth committed May 16, 2024
    Configuration menu
    Copy the full SHA
    7099361 View commit details
    Browse the repository at this point in the history