C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & more LLMs
-
Updated
Apr 29, 2024 - C++
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & more LLMs
Using the Chinese version of ChatGPT -- "ChatGLM" on Espressif's ESP32 platform by Arduino!
This project accelerates local deployment of chatglm and vector inference using PyTorch compiled in C++, and includes an OpenAI API Mock script for quick setup of local speed testing services. This setup enhances performance and efficiency, ideal for high-performance applications and development testing.
Add a description, image, and links to the chatglm topic page so that developers can more easily learn about it.
To associate your repository with the chatglm topic, visit your repo's landing page and select "manage topics."