Skip to content

Update TP parallel GEMM image#14112

Merged
stas00 merged 3 commits intohuggingface:masterfrom
hyunwoongko:master
Oct 22, 2021
Merged

Update TP parallel GEMM image#14112
stas00 merged 3 commits intohuggingface:masterfrom
hyunwoongko:master

Conversation

@hyunwoongko
Copy link
Copy Markdown
Contributor

I added column parallel and row parallel image

parallelism-tp-parallel_gemm

reviewers

@stas00

@hyunwoongko
Copy link
Copy Markdown
Contributor Author

this image is wrong.
don't merge now.
I'll update image and explanation.

@hyunwoongko
Copy link
Copy Markdown
Contributor Author

parallelism-tp-parallel_gemm

@hyunwoongko
Copy link
Copy Markdown
Contributor Author

hyunwoongko commented Oct 22, 2021

I updated image ! Can you merge this? @stas00

@stas00 stas00 merged commit 95bab53 into huggingface:master Oct 22, 2021
@stas00
Copy link
Copy Markdown
Contributor

stas00 commented Oct 22, 2021

Thank you for making the improvements, @hyunwoongko!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants