ChatterUI is a native mobile frontend for LLMs.
Run LLMs on device or connect to various commercial or open source APIs. ChatterUI aims to provide a mobile-friendly interface with fine-grained control over chat structuring.
If you like the app, feel free support me here:
Use on-device Models or APIs
Modify and customize to your liking
Personalize yourself
- Run LLMs on-device in Local Mode
- Connect to various APIs in Remote Mode
- Chat with characters. (Supports the Character Card v2 specification.)
- Create and manage multiple chats per character.
- Customize Sampler fields and Instruct formatting
- Integrates with your device’s TTS engine for text-to-speech (TTS) support
Download and install latest APK from the releases page.
IOS is Currently unavailable, I do not have the hardware for IOS development
ChatterUI uses a llama.cpp under the hood to run gguf files on device. A custom adapter is used to integrate with react-native: cui-llama.rn
To use on-device inferencing, first enable Local Mode, then go to Models > Import Model / Use External Model and choose a gguf model that can fit on your device's memory. The importing functions are as follows:
- Import Model: Copies the model file into ChatterUI, potentially speeding up startup time.
- Use External Model: Uses a model from your device storage directly, removing the need to copy large files into ChatterUI but with a slight delay in load times.
After that, you can load the model and begin chatting!
Note: For devices with Snapdragon 8 Gen 1 and above or Exynos 2200+, it is recommended to use the Q4_0_4_8 quantization for enhanced prompt processing.
Remote Mode allows you to connect to a few common APIs from both commercial and open source projects.
- koboldcpp
- text-generation-webui
- Ollama
- OpenAI
- Claude (with ability to use a proxy)
- Cohere
- Open Router
- Mancer
- AI Horde
- Generic Text Completions
- Generic Chat Completions
These should be compliant with any Text Completion/Chat Completion backends such as Groq or Infermatic.
To run a development build, follow these simple steps:
- Install any Java 17/21 SDK of your choosing
- Install
android-sdk
viaAndroid Studio
- Clone the repo:
git clone https://github.com/Vali-98/ChatterUI.git
- Install dependencies via npm and run via Expo:
npm install
npx expo run:android
Requires Node.js, Java 17/21 SDK and Android SDK. Expo uses EAS to build apps which requires a Linux environment.
- Clone the repo.
- Rename the
eas.json.example
toeas.json
. - Modify
"ANDROID_SDK_ROOT"
to the directory of your Android SDK - Run the following:
npm install
eas build --platform android --local
Currently untested as I do have the resources to develop for IoS. Assistance here would be greatly appreciated!
(Note: This is only applicable for versions prior to Expo SDK 51 in 20fbff2fb6375cfd0d76acf06a9cd13ae9126c57)
ReactNativeFlipper causes streaming to break on Android development builds. To fix this, navigate to:
android/app/src/main/java/com/Vali98/ChatterUI/MainApplication.kt
Then comment out the following:
if (BuildConfig.DEBUG) {
// hacky fix for: https://github.com/react-native-community/fetch
// ReactNativeFlipper.initializeFlipper(this, reactNativeHost.reactInstanceManager)
}