Meet Aria. A local and uncensored AI entity.
aria_demo.mp4
Clone the repo.
Install required libs.
For llama llms installation check here
Easy installation for server mode using docker:
docker buildx build --tag ghcr.io/lef-fan/aria-server:latest .
(Tested on Linux + NVIDIA GPUs with python >=3.10)
More are coming, work in progress...
First run will take a while to download all the required models.
You may edit the default config for your device or use case (change model, specify devices, etc...)
If you have the resources, strongly recommended to use a model of bigger quant method such as:
mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf
python main.py
server machine:
python server.py
or docker for server:
docker run --net=host --gpus all --name aria-server -it ghcr.io/lef-fan/aria-server:latest
python server.py
client machine (edit client target ip in the config):
python client.py
Work in progress...
🌟 We'd love your contribution! Please submit your changes via pull request to join in the fun! 🚀
Aria is a powerful AI entity designed for local use. Users are advised to exercise caution and responsibility when interacting with Aria, as its capabilities may have unintended consequences if used improperly or without careful consideration.
By engaging with Aria, you understand and agree that the suggestions and responses provided are for informational purposes only, and should be used with caution and discretion.
We cannot be held responsible for any actions, decisions, or outcomes resulting from the use of Aria. We explicitly disclaim liability for any direct, indirect, incidental, consequential, or punitive damages arising from reliance on Aria's responses.
We encourage users to exercise discernment, judgment, and thorough consideration when utilizing information from Aria. Your use of this service constitutes acceptance of these disclaimers and limitations.
Should you have any doubts regarding the accuracy or suitability of Aria's responses, we advise consulting with qualified professionals or experts in the relevant field.
While this project is licensed under GNU AGPLv3, the usage of some of the components it depends on might not and they will be listed below:
- License: Open-source only for non-commercial projects.
- Commercial Use: Requires a paid plan.
- Details: Coqui Public Model License 1.0.0
