GNOME Phi Chat

Simple GTK3 LLM chat application written using .NET powered by Phi-3-mini.

Uses:

• .NET 9
• GTK# for Linux and Windows (bundles GTK# Runtime for Windows)
• ONNX Runtime GenAI

Supports:

• Windows and Linux on x64
• Windows on Arm only functions via emulation due to a limitation in GTK#
• Linux on Arm requires building QNNX dependencies from source

Download model and data:

huggingface-cli download microsoft/Phi-3-mini-4k-instruct-onnx --include cpu_and_mobile/cpu-int4-rtn-block-32-acc-level-4/* --local-dir Phi-3-mini-4k-instruct-onnx

Build

dotnet restore
dotnet build
dotnet run