Skip to content

support int8 & share context#1

Merged
void-main merged 3 commits intovoid-main:mainfrom
CN-COTER:dev_support_int8_share_ctx
Jul 2, 2023
Merged

support int8 & share context#1
void-main merged 3 commits intovoid-main:mainfrom
CN-COTER:dev_support_int8_share_ctx

Conversation

@CN-COTER
Copy link
Copy Markdown

No description provided.

Copy link
Copy Markdown
Owner

@void-main void-main left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution! Really appreciate it!!!

Left some comments, could you please take a 👀

❤️

Comment thread src/fastertransformer/.DS_Store Outdated
Comment thread examples/cpp/llama/llama_example.cc Outdated
Comment thread src/fastertransformer/models/llama/Llama.cc Outdated
Comment thread src/fastertransformer/models/llama/LlamaContextDecoder.cc Outdated
Comment thread src/fastertransformer/models/llama/LlamaContextDecoder.cc
Comment thread src/fastertransformer/models/llama/LlamaDecoderLayerWeight.cc
Copy link
Copy Markdown
Owner

@void-main void-main left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution!

@void-main void-main merged commit 98435f1 into void-main:main Jul 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants