New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Generalized layer types and row parallel split logic #110

Merged

tgaddair merged 1 commit into main from fix-c-proj2

Dec 6, 2023

Contributor

tgaddair commented Dec 6, 2023 •

edited

Fixes a key conflict where c_proj was used for different layers in different modules.


          Generalized layer types and row parallel split logic

3f4bb1f

tgaddair requested a review from geoffreyangus

December 6, 2023 17:19

tgaddair mentioned this pull request

fix: Distinct c_proj for attention and mlp layers #108

Closed

geoffreyangus approved these changes

View reviewed changes

tgaddair merged commit f2f0521 into main

1 check failed

tgaddair deleted the fix-c-proj2 branch

December 6, 2023 17:56

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment