Skip to content

feat: add TP support for bitsandbytes - #798

Draft
AlpinDale wants to merge 1 commit into
mainfrom
bnb_tp
Draft

feat: add TP support for bitsandbytes#798
AlpinDale wants to merge 1 commit into
mainfrom
bnb_tp

Conversation

@AlpinDale

Copy link
Copy Markdown
Member

Adapted from vllm-project/vllm#8434

@AlpinDale
AlpinDale marked this pull request as draft November 2, 2024 12:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant