Skip to content

Conversation

@grimoire
Copy link
Collaborator

@grimoire grimoire commented Jul 24, 2023

Support Both deploy-time TP and runtime TP
Support GQA runtime TP
Code is so ugly.

Copy link
Collaborator

@tpoisonooo tpoisonooo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

update README.md all together.

Copy link
Collaborator

@tpoisonooo tpoisonooo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

文档需额外声明量化不能动态 tp

@lvhan028 lvhan028 merged commit 4767b04 into InternLM:main Jul 31, 2023
@lvhan028 lvhan028 added the enhancement New feature or request label Jul 31, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants