New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[autoparallel] complete gpt block searching #2065

Merged

FrankLeeeee merged 2 commits into hpcaitech:main from YuliangLiu0306:feature/gpt_block_searching

Dec 6, 2022

Contributor

YuliangLiu0306 commented Dec 2, 2022

What does this PR do

Integrate GPT2Block, GPT2MLP, and GPT2Attention in one unit test file.
Temporarily，disable the node merging for a special case of binary element-wise kernel, in that case, one of the two inputs should be a scalar, then the handler will fall back to use the unary element-wise kernel logic to do the strategy registration.


          [autoparallel] complete gpt block searching

4d9d653

YuliangLiu0306 added the Run Build and Test label


          fix test

f8ce95a

FrankLeeeee approved these changes

View reviewed changes

FrankLeeeee merged commit f123476 into hpcaitech:main

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment