Add rms_norm backward kernels #597
Conversation
meta-cla
bot
added
the
CLA Signed
|
@mengluy0125 has exported this pull request. If you are a Meta employee, you can view the originating diff in D82359685. |
Summary: We add the backward pass for rms_norm kernel Differential Revision: D82359685
mengluy0125
force-pushed
the
export-D82359685
branch
from
f9d50a2 to
73f1eee
Compare
|
@mengluy0125 has exported this pull request. If you are a Meta employee, you can view the originating diff in D82359685. |
Summary: We add the backward pass for rms_norm kernel Differential Revision: D82359685
mengluy0125
force-pushed
the
export-D82359685
branch
from
73f1eee to
8612505
Compare
|
@mengluy0125 has exported this pull request. If you are a Meta employee, you can view the originating diff in D82359685. |
Summary: We add the backward pass for rms_norm kernel Differential Revision: D82359685
mengluy0125
force-pushed
the
export-D82359685
branch
from
8612505 to
52ee097
Compare
|
@mengluy0125 has exported this pull request. If you are a Meta employee, you can view the originating diff in D82359685. |
Summary: We add the backward pass for rms_norm kernel Differential Revision: D82359685
mengluy0125
force-pushed
the
export-D82359685
branch
from
52ee097 to
c555c08
Compare
|
@mengluy0125 has exported this pull request. If you are a Meta employee, you can view the originating diff in D82359685. |
There was a problem hiding this comment.
thanks @mengluy0125 ! lgtm overall, and there are some linter error that needs fix. Also added an internal comment on the diff.
Summary: We add the backward pass for rms_norm kernel Differential Revision: D82359685
mengluy0125
force-pushed
the
export-D82359685
branch
from
c555c08 to
b786e9d
Compare
|
@mengluy0125 has exported this pull request. If you are a Meta employee, you can view the originating diff in D82359685. |
Summary: We add the backward pass for rms_norm kernel
Differential Revision: D82359685