Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Megablocks-based MoE #1197

Closed
wants to merge 7 commits into from
Closed

Megablocks-based MoE #1197

wants to merge 7 commits into from

Commits on Mar 27, 2024

  1. feat: megablocks grouped gemm-based implementation

    @DayOfThePenguin
    DayOfThePenguin committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    923afa6 View commit details
    Browse the repository at this point in the history

  2. fix: run pre-commit

    @DayOfThePenguin
    DayOfThePenguin committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    01c9577 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. Update moe.py

    @StellaAthena
    StellaAthena committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    c2cc9c4 View commit details
    Browse the repository at this point in the history

  2. Update moe_mlp.py

    @StellaAthena
    StellaAthena committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    c7bfed0 View commit details
    Browse the repository at this point in the history

  3. Update moe.py

    @StellaAthena
    StellaAthena committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    bde88e8 View commit details
    Browse the repository at this point in the history

  4. Update router.py

    @StellaAthena
    StellaAthena committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    89aa3f0 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2024

  1. fix: router inference time topk -> top_k

    @DayOfThePenguin
    DayOfThePenguin committed May 4, 2024
    Configuration menu
    Copy the full SHA
    6697b0c View commit details
    Browse the repository at this point in the history