Repository navigation
Mintu v0.2.0 - Community, Voice, Vision & Living Pet Update
The Mintu v0.2.0 release encompasses the 7th and 8th stages of the project, along with critical fixes that enhance the user experience. With this version, Mintu evolves from a simple AI assistant into an interactive companion that lives on your desktop—controlled by your voice and extensible by the community.
New Features and Improvements:
- Dynamic Island and Slot System (IslandLayout):
- A dedicated, fixed slot (mintuSlot) with a width of 52px has been established on the left side of the "island" specifically for Mintu.
- Notification icons are prevented from being obscured by Mintu; a clear, visible gap of 12–16px is maintained between the "pet" and the application icon.
- When Mintu moves freely outside the island ("Free mode"), the left slot is removed, allowing notifications to begin from the far-left edge.
- If Mintu is asleep, it wakes up immediately upon the arrival of a notification—clearing any 'z' particles—and shifts into an alert state; 1.5 seconds after the notification is closed, it smoothly returns to its previous state.
- Voice and Live Interaction:
- Multilingual microphone input: Allows users to ask questions and execute commands via voice in Azerbaijani, English, Russian, and other languages. - Support for automatic language detection (Whisper and Gemini Flash).
- Mandatory automatic text-to-speech for responses has been removed; it is now optional based on user preference.
- Desktop Assistant and Visual Intelligence:
- Smart Clipboard: When text is copied (Ctrl+C), a suggestion appears in a small overlay (e.g., to review code, translate into Azerbaijani, or format as JSON).
- Multimodal screen analysis and offline OCR integration.
- Desktop commands via small local models: instantly launch Google, Spotify, YouTube, GitHub, the calculator, or Notepad.
- Gamification and Virtual Pet (Gamification & Wardrobe):
- Earn experience points (XP) and level up through Pomodoro and work sessions.
- Use earned points to equip accessories from the wardrobe, such as glasses, a winter hat, a coffee cup, or headphones.
- Enhanced physics, the ability to sit on the edges of active windows, and reactions to the cursor.
- Community and Plugin System:
- Open plugin architecture (small widgets and service integrations via
manifest.json). - Customizable JSON templates for unique pet skins.
- System Convenience:
- Option for automatic startup with Windows. - Tray menu next to the system clock (one-click access to Pomodoro, silent mode, or AI chat).
- Automatic update notifications linked to GitHub Releases.
Global Shortcuts:
- Ctrl + Alt + Space : Read selected text and the active application context
- Ctrl + Alt + S : Select a screen area for offline OCR reading
- Ctrl + Alt + M : Toggle between Dynamic Island and Free-roaming Pet modes
- Ctrl + Shift + D : Developer diagnostics panel and slot frames
- Escape : Collapse the island or close the window