Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add main_grad #1140

Open
wants to merge 4 commits into
base: ngoyal_changes_for_pp_fp8
Choose a base branch
from
Open

Add main_grad #1140

wants to merge 4 commits into from

Commits on Oct 2, 2023

  1. Fix fsdp+pp+te WPS decreasing issue

    @jianyuh
    jianyuh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    81ee78d View commit details
    Browse the repository at this point in the history

  2. Address comment; remove unused stuff

    @jianyuh
    jianyuh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    71495ba View commit details
    Browse the repository at this point in the history

  3. split into wps fix P841842878 only and main_grad fix

    @jianyuh
    jianyuh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    f3ae46e View commit details
    Browse the repository at this point in the history

  4. Add main_grad

    @jianyuh
    jianyuh committed Oct 2, 2023
    Configuration menu
    Copy the full SHA
    ad54660 View commit details
    Browse the repository at this point in the history