Local AI Vtuber (A tool for hosting AI vtubers that runs fully locally and offline)

• Chatbot, Translation and Text-to-Speech, all completely free and running locally.
• Support voice output in Japanese, English, German, Spanish, French, Russian and more, powered by RVC, silero and voicevox.
• Includes custom finetuned model to avoid generic chatbot responses and breaking character.
• Gradio UI web interface.
• plugin support for easily adding other providers.

early test stream (https://www.youtube.com/live/9LK_-pqz8Ts?si=yUd-Wz6xV6wXt-t7)

Installation

Prepackaged zip (recommended)

If you are a Windows user, you can download the integrated package and double-click on run.bat to start the webUI.

Manual setup

1. Download the project as zip from releases
2. Extract and double click run.bat
3. When you see this message, go to http://localhost:7860 to see web UI

Running on local URL:  http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.

TODO (This project is still under development and more features are planned)

• Fetch chat input from streaming platforms (Finished)
• Improve local LLM (Finetuned model avaliable https://huggingface.co/xiaoheiqaq/Aya-7b-gguf)
• Write plugins for cloud providers(Azure tts, elevenlabs, chatgpt, whisper...)
• GPU support
• Vtube studio integration (Finished)
• Let AI play games and provide commentary. (can play chess through lichess)
• AI singing

FAQ:

• To fetch chat from Youtube, copy the youtube_video_id from the stream url like this:

Then press start fetching chat