Skip to content

Local AI Unity Tool 0.0.1

Choose a tag to compare

@Akshayykadam Akshayykadam released this 18 Dec 15:53
· 23 commits to main since this release

🚀 v0.0.1 - Initial Release

Welcome to the first official release of the Local AI Assistant for Unity! This tool brings the power of Large Language Models directly into your Unity Editor workflow, with a focus on privacy and performance.


✨ Key Features

  • 🔒 100% Private & Offline: All processing happens locally. No data ever leaves your machine. All inference is performed locally using your CPU or GPU.
  • ⚡ Native Performance: Integrated with llama.cpp for high-performance inference, supporting Apple Silicon (Metal) and Windows (AVX2).
  • 🛠️ Unity-Native UI: Built entirely with Unity's UI Toolkit, ensuring a seamless look and feel that matches the Editor.
  • 🎯 C#-Focused Generation: Fine-tuned logic ensures the AI prioritizes C# and Unity-specific code, avoiding irrelevant language outputs.
  • 📦 Automated Setup: One-click installation for native binaries and an easy-to-use model downloader.
  • ⚙️ Highly Configurable: Adjust context window sizes (up to 8K) and response lengths to fit your hardware and requirements.

🏗️ Technical Stack

  • Model: Mistral 7B Instruct (v0.1) in GGUF format (Q4_K_M).
  • Backend: llama.cpp ARM64/x64 native libraries.
  • Integration: Safe P/Invoke marshalling in C#.
  • UI Framework: Unity UI Toolkit (UXML/USS).

🚀 Quick Start

  1. Open Tools → Local AI → Install Native Libraries to setup binaries.
  2. Open Tools → Local AI Assistant → Settings to download the Mistral model.
  3. Start chatting with your AI assistant using the main window.

Built with ❤️ for the Unity Community.