🤝 Dost - AI Desktop Assistant

An AI-powered desktop assistant that can control your PC, manage your emails, play music, fetch live market data, and much more - all through natural language.

Built on the Model Context Protocol (MCP)

🧭 What is Dost?

Dost (meaning "friend" in Hindi) is a modular AI assistant ecosystem that connects large language models to real-world tools using the Model Context Protocol (MCP). Ask it anything in plain English - from "What's the weather in Tokyo?" to "Open Spotify and play some jazz" - and it figures out which tools to call.

Key Highlights

🖥️ Windows Desktop Control — Open/close apps, manage windows, adjust volume & brightness, take screenshots, schedule tasks
📧 Google Suite Integration — Read/send Gmail, manage Google Calendar events, browse contacts (OAuth 2.0)
🎵 Spotify Control — Play, pause, skip, search, switch devices (OAuth 2.0)
📈 Live Market Data — Real-time stock prices, cryptocurrency, metal prices, currency conversion
🌤️ Weather — Current weather for any city worldwide
🧮 Calculator — Math operations on datasets (sum, product, min, max, average)
🧠 Smart Tool Selection — Semantic RAG-based tool routing picks the right tool for each query
🔐 Secure by Design — Input validation, rate limiting, sandboxed execution

🏗️ Architecture

┌──────────────────────────────────────────────────────────────────┐
│                          Dost Ecosystem                          │
├──────────────────────┬──────────────────┬────────────────────────┤
│   CLIENTS            │   BACKEND        │   MCP SERVERS          │
│                      │                  │                        │
│ ┌──────────────────┐ │ ┌──────────────┐ │ ┌────────────────────┐ │
│ │ mcp-desktop-     │ │ │ mcp-server-  │ │ │ mcp-server-remote  │ │
│ │ client           │ │ │ web          │ │ │ (HTTP / Streamable)│ │
│ │ (Electron+React) │─┼─│ (FastAPI +   │ │ │                    │ │
│ │                  │ │ │  PostgreSQL) │ │ │ Weather, Stocks,   │ │
│ └──────────────────┘ │ └──────────────┘ │ │ Crypto, Metals,    │ │
│                      │                  │ │ Currency, Gmail,   │ │
│ ┌──────────────────┐ │                  │ │ Calendar, Contacts,│ │
│ │ mcp-frontend-web │ │                  │ │ Spotify, Calculator│ │
│ │ (Next.js)        │─┼──────────────────│ └────────────────────┘ │
│ └──────────────────┘ │                  │                        │
│                      │                  │ ┌────────────────────┐ │
│ ┌──────────────────┐ │                  │ │ mcp-server-package │ │
│ │ mcp-client       │ │                  │ │ (stdio)            │ │
│ │ (Python CLI)     │─┼──────────────────│ │                    │ │
│ └──────────────────┘ │                  │ │ Windows Automation,│ │
│                      │                  │ │ Time, File Ops,    │ │
│                      │                  │ │ Notifications      │ │
│                      │                  │ └────────────────────┘ │
└──────────────────────┴──────────────────┴────────────────────────┘

📂 Project Structure

dost/
├── mcp-desktop-client/    # Electron + React desktop app (primary client)
│   ├── client/            #   React frontend (Vite, ShadcnUI)
│   └── electron/          #   Main process, MCP bridge, AI model mgr, Express server
│
├── mcp-frontend-web/      # Next.js web frontend (alternative UI)
│
├── mcp-server-web/        # FastAPI backend — auth, chat persistence, user mgmt
│   ├── routers/           #   API routes (auth, users, chats, api-keys, mcp-store, llm-models)
│   ├── models/            #   SQLAlchemy models (User, Chat)
│   └── database.py        #   Async PostgreSQL via asyncpg
│
├── mcp-server-remote/     # Remote MCP server (HTTP / Streamable)
│   ├── tools/             #   Tool modules (stock, crypto, metal, currency, gmail, calendar, contacts, spotify)
│   └── auth/              #   Google & Spotify OAuth 2.0 flows
│
├── mcp-server-package/    # Local MCP server (stdio transport)
│   └── tools/             #   Windows automation modules
│       ├── windows.py     #     Window & task management, reminders, system info
│       └── modules/       #     application_manager, system_control, desktop_interaction, file_operations, security
│
├── mcp-client/            # Python CLI MCP client
├── flet_client/           # Flet-based desktop UI (experimental)
└── .env                   # Root environment variables

⚙️ Prerequisites

Requirement	Version
Node.js	18+
Python	3.11+
PostgreSQL	14+ (for `mcp-server-web`)

🚀 Getting Started

1. Clone the repo

git clone https://github.com/your-username/dost.git
cd dost

2. Set up environment variables

Each component that needs secrets has its own .env file. Copy and fill in the values:

Root .env — LLM & API keys

GROQ_API_KEY=gsk_...
WEATHER_API_KEY=...

mcp-desktop-client/.env — Desktop client config

VITE_API_URL=http://localhost:5000/api/v1
GROQ_API_KEY=gsk_...
GOOGLE_CLIENT_ID=...
GOOGLE_CLIENT_SECRET=...
VITE_SUMMARY_MAX_TOKENS=800
VITE_SUMMARY_TOKEN_THRESHOLD=1500

mcp-server-web/.env — Backend config

DATABASE_URL=postgres://user:password@host:5432/dbname
DEV_MODE=true
PORT=8000
SECRET_KEY=your-jwt-secret

mcp-server-remote/.env — Remote server & OAuth

WEATHER_API_KEY=...
GOOGLE_CLIENT_ID=...
GOOGLE_CLIENT_SECRET=...
SPOTIFY_CLIENT_ID=...
SPOTIFY_CLIENT_SECRET=...
SPOTIFY_REDIRECT_URI=http://localhost:8000/auth/spotify_callback

3. Start the components

You can run any combination of these depending on your use case.

Remote MCP Server (HTTP tools)

cd mcp-server-remote
python -m venv .remotevenv && .remotevenv\Scripts\activate   # Windows
pip install -r requirements.txt
python server.py
# → Runs at http://localhost:8000
# → MCP endpoint: http://localhost:8000/remote_mcp
# → API docs: http://localhost:8000/docs

Local MCP Server (stdio / Windows tools)

cd mcp-server-package
python -m venv .packagevenv && .packagevenv\Scripts\activate
pip install -r requirements.txt
python server.py
# → Communicates via stdio (launched by the desktop client)

Web Backend (auth, chat history, user management)

cd mcp-server-web
python -m venv .webserver && .webserver\Scripts\activate
pip install -r requirements.txt
python main.py
# → Runs at http://localhost:8000 (configure PORT in .env)

Desktop Client (Electron app)

cd mcp-desktop-client
npm run install:all   # Installs root, client, and electron deps
npm run dev           # Starts Vite dev server + Electron

Web Frontend (Next.js)

cd mcp-frontend-web
npm install
npm run dev
# → Runs at http://localhost:3000

CLI Client (Python)

cd mcp-client
pip install -r requirements.txt   # if applicable
python client.py

🛠️ Registered MCP Tools

Remote Server (`mcp-server-remote`) — HTTP

Category	Tool	Description
Weather	`get_weather`	Current weather for any city
Finance	`get_stock_data`	Real-time stock quotes
	`get_crypto_price`	Cryptocurrency prices + history
	`get_metal_price`	Precious metal prices (gold, silver, …)
	`convert_currency`	Live currency conversion
Math	`calculator`	Sum, product, min, max, average
Google	`read_recent_emails`	Read Gmail inbox (OAuth)
	`send_email`	Send emails via Gmail (OAuth)
	`list_calendar_events`	View Google Calendar (OAuth)
	`create_calendar_event`	Create calendar events (OAuth)
	`list_contacts`	Browse Google Contacts (OAuth)
Spotify	`get_current_playback`	Now playing info (OAuth)
	`play_spotify` / `pause_spotify`	Playback control (OAuth)
	`next_track_spotify` / `previous_track_spotify`	Track navigation (OAuth)
	`start_spotify_playback`	Start playing a track/playlist (OAuth)
	`search_spotify`	Search tracks, albums, artists (OAuth)
	`list_spotify_devices` / `set_spotify_device`	Device management (OAuth)

Local Server (`mcp-server-package`) — stdio

Category	Tool	Description
Apps	`open_app`	Launch desktop applications
	`open_webpage`	Open URLs in default browser
	`search_web`	Search Google/Bing
	`play_song`	Play a song on YouTube
Windows	`list_open_windows`	List visible windows
	`focus_window` / `minimize_window` / `maximize_window` / `close_window`	Window management
System	`volume_control`	Adjust system volume
	`brightness_control`	Adjust screen brightness
	`system_power`	Shutdown, restart, hibernate, lock
	`get_system_info`	OS, CPU, RAM, disk info
Desktop	`screenshot`	Capture the screen
	`clipboard_manager`	Get/set clipboard text
	`show_notification`	Show Windows toast notifications
Files	`create_note`	Create text/note files
	`find_files`	Search files on disk
Scheduling	`schedule_task` / `list_scheduled_tasks` / `delete_scheduled_task`	Windows Task Scheduler
	`set_reminder`	Time-based alerts
Time	`get_time`	Current time for any timezone

🧠 Smart Tool Selection (RAG)

The desktop client uses a vector-store-based Retrieval-Augmented Generation (RAG) system to semantically match user queries to the most relevant MCP tools. This means the LLM only receives tools that are actually relevant to the query, keeping token usage low and accuracy high.

See mcp-desktop-client/electron/mcp/TOOL_RAG.md for implementation details.

🔒 Security

The local Windows automation server includes a multi-layered security model:

Input validation — All tool inputs are sanitized and validated
Rate limiting — Prevents abuse of system-level operations
Path sandboxing — File operations are restricted to allowed directories
Command whitelisting — Only pre-approved applications and commands can be executed
Configurable — Security settings in mcp-server-package/tools/settings.json

📡 OAuth Integration

Google and Spotify integrations use OAuth 2.0 flows managed by the remote server:

Start — POST /auth/start (Google) or POST /auth/start_spotify (Spotify)
Callback — Browser redirects back to /auth/callback or /auth/spotify_callback
Status — GET /auth/status/google/{service} or GET /auth/status/spotify

Tokens are stored per-user and auto-refreshed when expired.

🔍 Inspecting MCP Servers

You can inspect any MCP server using the official inspector:

npx @modelcontextprotocol/inspector

🏗️ Building the Desktop App

cd mcp-desktop-client

# Unpacked build (for testing)
npm run dist:dir

# Full NSIS installer (.exe)
npm run dist

Output is written to mcp-desktop-client/release/.

⚠️ Make sure .env contains real values before packaging — it is bundled into the app resources.

📄 License

This project is open-source. See individual component directories for specific license information.

Made with ❤️ — Your AI dost (friend) that actually gets things done.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Repository files navigation

🤝 Dost - AI Desktop Assistant

🧭 What is Dost?

Key Highlights

🏗️ Architecture

📂 Project Structure

⚙️ Prerequisites

🚀 Getting Started

1. Clone the repo

2. Set up environment variables

3. Start the components

Remote MCP Server (HTTP tools)

Local MCP Server (stdio / Windows tools)

Web Backend (auth, chat history, user management)

Desktop Client (Electron app)

Web Frontend (Next.js)

CLI Client (Python)

🛠️ Registered MCP Tools

Remote Server (`mcp-server-remote`) — HTTP

Local Server (`mcp-server-package`) — stdio

🧠 Smart Tool Selection (RAG)

🔒 Security

📡 OAuth Integration

🔍 Inspecting MCP Servers

🏗️ Building the Desktop App

📄 License

About

Uh oh!

Releases

Packages

Uh oh!

Contributors

Uh oh!

Languages

Name		Name	Last commit message	Last commit date
Latest commit History 87 Commits
docs		docs
flet_client		flet_client
mcp-client		mcp-client
mcp-desktop-client		mcp-desktop-client
mcp-frontend-web		mcp-frontend-web
mcp-server-package		mcp-server-package
mcp-server-remote		mcp-server-remote
mcp-server-web		mcp-server-web
.gitignore		.gitignore
README.md		README.md
TASKS.md		TASKS.md
tools_enriched.json		tools_enriched.json

Folders and files

Latest commit

History

Repository files navigation

🤝 Dost - AI Desktop Assistant

🧭 What is Dost?

Key Highlights

🏗️ Architecture

📂 Project Structure

⚙️ Prerequisites

🚀 Getting Started

1. Clone the repo

2. Set up environment variables

3. Start the components

Remote MCP Server (HTTP tools)

Local MCP Server (stdio / Windows tools)

Web Backend (auth, chat history, user management)

Desktop Client (Electron app)

Web Frontend (Next.js)

CLI Client (Python)

🛠️ Registered MCP Tools

Remote Server (mcp-server-remote) — HTTP

Local Server (mcp-server-package) — stdio

🧠 Smart Tool Selection (RAG)

🔒 Security

📡 OAuth Integration

🔍 Inspecting MCP Servers

🏗️ Building the Desktop App

📄 License

About

Resources

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

Remote Server (`mcp-server-remote`) — HTTP

Local Server (`mcp-server-package`) — stdio

Packages