From 8185661795edc33870b9208b0f333ad4a73f46c3 Mon Sep 17 00:00:00 2001 From: Shilong Jiang Date: Thu, 27 Apr 2023 10:08:22 +0000 Subject: [PATCH] add an online tutorial on deploying quantized MOSS --- README.md | 1 + README_en.md | 1 + 2 files changed, 2 insertions(+) diff --git a/README.md b/README.md index 04ab76c..ceae3b4 100644 --- a/README.md +++ b/README.md @@ -467,6 +467,7 @@ bash run.sh - [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - 将MOSS接入视频问答 - [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - 支持在线部署MOSS的算力平台 - [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - 社区提供的Docker镜像，运行int4量化版和GradIOUI +- [V100单卡在线部署Int8量化版MOSS教程](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - 提供了量化版MOSS的部署样例，以及部署过程中一些问题的解决方法 如果您有其他开源项目使用或改进MOSS，欢迎提交Pull Request添加到README或在Issues中联系我们。 diff --git a/README_en.md b/README_en.md index de83eef..e60f132 100644 --- a/README_en.md +++ b/README_en.md @@ -450,6 +450,7 @@ Note: In the tokenizer of `moss-moon-003-base`, the eos token is `<|endoftext|>` - [VideoChat with MOSS](https://github.com/OpenGVLab/Ask-Anything/tree/main/video_chat_with_MOSS) - Watch videos with MOSS! - [ModelWhale](https://www.heywhale.com/mw/project/6442706013013653552b7545) - A compute platform for deploying MOSS! - [MOSS-DockerFile](https://github.com/linonetwo/MOSS-DockerFile) - Community-provided Docker images running int4 quantization and GradIOUI +- [An online tutorial on deploying quantized MOSS on single V100](https://www.heywhale.com/mw/project/6449f8fc3c3ad0d9754d8ae7) - A step-by-step tutorial on deploying moss-moon-003-sft-int8 is provided, and some specific solutions to common problems are also given If you have other open-sourced projects that used or improved MOSS, please feel free to submit Pull Requests to README or reach out to us in Issues.