A modern AI-powered Desktop Assistant built using Java (Swing) that can perform system tasks, understand voice commands, automate actions, and respond intelligently using AI.
- Integrated with Gemini AI for intelligent responses
- Natural language command processing
- AI fallback when no local feature matches
- Voice input using Wit.ai Speech API
- Converts speech → text → executes commands
- Optional Text-to-Speech (TTS) using PowerShell + System.Speech
- Open / close applications
- Control system functions:
- Volume up/down
- Mute sound
- Lock screen
- Display system information
- Search files across system
- Open file location automatically
- Create / delete / rename files & folders
- Open files directly
- Time & Date
- Clipboard history
- Web search
- YouTube search
- File search with input prompt
- Command history tracking
- App usage tracking
- Background threaded execution (no UI freezing)
- Custom dark-themed UI
- Chat-style interface
- Sidebar quick commands
- Animated microphone feedback
- Java (Swing)
- Java Sound API
- Multithreading
- Wit.ai (Speech Recognition)
- Gemini API (AI responses)
- Apache HttpClient (API calls)
- Gson (JSON parsing)
org.example
│── Main.java
│
└── features
│── Feature.java
│── AppLaunchFeature.java
│── FileSearchFeature.java
│── SystemControlFeature.java
│── GeminiFeature.java
│── TextToSpeech.java
│── UsageTracker.java
git clone https://github.com/your-username/desktop-assistant.git
cd desktop-assistant
Create a .env file:
WIT_AI_TOKEN=your_wit_ai_key
GEMINI_API_KEY=your_gemini_key
mvn clean install
mvn exec:java
OR run Main.java directly in IntelliJ / Eclipse.
Access keys using:
AppConfig.WIT_AI_TOKEN
AppConfig.GEMINI_API_KEY
- User enters text or voice command
- Input is processed in background thread
- System checks features:
- If matched → execute locally
- Else → send to Gemini AI
- Response is displayed (and optionally spoken)
Uses Windows PowerShell + System.Speech
Flow:
Java → PowerShell → SpeechSynthesizer → Audio Output
Threads are used for:
- Voice recording
- API calls
- File searching
- Command execution
Ensures smooth and responsive UI.
- Cross-platform voice engine
- Offline AI support
- Smart suggestions
- Plugin system
- Mobile integration
- Personal assistant
- Productivity automation
- Hands-free system control
- AI chatbot interface
Vivek Patil, Tarang Acharya, Jinal Varu
If you like this project:
- Star ⭐ the repository
- Fork 🍴 it
- Contribute 💡
For educational and personal use.