Skip to content

add an online tutorial on deploying quantized MOSS #197

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Apr 27, 2023
Merged

add an online tutorial on deploying quantized MOSS #197

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -467,6 +467,7 @@ bash run.sh
- [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - 将MOSS接入视频问答
- [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - 支持在线部署MOSS的算力平台
- [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - 社区提供的Docker镜像，运行int4量化版和GradIOUI
- [V100单卡在线部署Int8量化版MOSS教程](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - 提供了量化版MOSS的部署样例，以及部署过程中一些问题的解决方法

如果您有其他开源项目使用或改进MOSS，欢迎提交Pull Request添加到README或在Issues中联系我们。

Expand Down
1 change: 1 addition & 0 deletions README_en.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -450,6 +450,7 @@ Note: In the tokenizer of `moss-moon-003-base`, the eos token is `<|endoftext|>`
- [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - Watch videos with MOSS!
- [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - A compute platform for deploying MOSS!
- [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - Community-provided Docker images running int4 quantization and GradIOUI
- [An online tutorial on deploying quantized MOSS on single V100](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - A step-by-step tutorial on deploying moss-moon-003-sft-int8 is provided, and some specific solutions to common problems are also given

If you have other open-sourced projects that used or improved MOSS, please feel free to submit Pull Requests to README or reach out to us in Issues.

Expand Down