Skip to content

Commit

Permalink
update
Browse files Browse the repository at this point in the history
  • Loading branch information
josStorer committed Mar 23, 2023
1 parent db670ad commit ea81568
Show file tree
Hide file tree
Showing 2 changed files with 29 additions and 1 deletion.
14 changes: 14 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,21 @@

# Self-Hosted AI

The API interface of this project is compatible with openai, and various open-source projects using openai can be easily
adapted. In addition, I also call on everyone to develop compatible API interfaces in a similar way, which is conducive
to the development of related applications.

## Usage Example

Go to https://github.com/josStorer/chatGPTBox, and switch to the following API mode to quickly experience:

<img width=350 src="https://user-images.githubusercontent.com/13366013/227125297-a933d37b-9af8-49a3-907d-9bd769cbabea.png">

## Chat

1. [ChatGLM 6B Int4](https://github.com/THUDM/ChatGLM-6B)
- [Offline](https://github.com/josStorer/selfhostedAI/releases)
- [Self-Hosted](https://huggingface.co/spaces/josStorer/ChatGLM-6B-Int4-API-OpenAI-Compatible)

This package is based on ChatGLM, open-sourced under the Apache-2.0 license. The built-in model is a trimmed version
of https://huggingface.co/silver/chatglm-6b-int4-slim. After unzipping, simply double-click run.bat to launch.
16 changes: 15 additions & 1 deletion README_ZH.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,21 @@

# 自托管AI

该项目的API接口兼容openai, 各类使用openai的开源项目能够非常方便适配, 此外我也呼吁大家使用相似的方式开发兼容性API接口,
便于相关应用的发展

## 使用示例

前往 https://github.com/josStorer/chatGPTBox, 并切换至如下API模式即可快速体验:

<img width=350 src="https://user-images.githubusercontent.com/13366013/227125297-a933d37b-9af8-49a3-907d-9bd769cbabea.png">

## 聊天

1. [ChatGLM 6B Int4](https://github.com/THUDM/ChatGLM-6B)
- [离线包](https://github.com/josStorer/selfhostedAI/releases), 可选[百度网盘](https://pan.baidu.com/s/1wchIUHgne3gncIiLIeKBEQ?pwd=1111)
- [离线包](https://github.com/josStorer/selfhostedAI/releases),
可选[百度网盘](https://pan.baidu.com/s/1wchIUHgne3gncIiLIeKBEQ?pwd=1111)
- [自托管](https://huggingface.co/spaces/josStorer/ChatGLM-6B-Int4-API-OpenAI-Compatible)

该包基于ChatGLM, 遵循Apache-2.0协议开源, 内置模型为 https://huggingface.co/silver/chatglm-6b-int4-slim 的裁切版,
解压后直接双击run.bat启动,

0 comments on commit ea81568

Please sign in to comment.