Skip to content

Repository files navigation

Clueless

An invisible, always-on-top desktop AI assistant overlay for meetings, interviews, and presentations — with screenshot understanding, chat, debugging via follow-up screenshots, and (optional) live call captions + reply suggestions.

Powered by:

  • Groq Cloud (LLM + vision)
  • Deepgram (optional, live transcription for Call Assist)
  • Supermemory (optional, personal knowledge base + “About You”)

🚀 Quick Start Guide

Prerequisites (All Platforms)


🍎 macOS Installation & Setup

Step 1: Install Prerequisites

# Install Homebrew (if not installed)
/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"

# Install Node.js
brew install node

# Verify installation
node --version  # Should show v18.x.x or higher
pnpm --version

Step 2: Clone and Install

# Clone the repository
git clone https://github.com/00-Aakash-00/clueless.git
cd clueless

# Install dependencies
pnpm install

# If you encounter Sharp/Python build errors:
SHARP_IGNORE_GLOBAL_LIBVIPS=1 pnpm install --ignore-scripts
pnpm rebuild sharp

Step 3: Configure Environment

# Create .env file
touch .env

# Open in your preferred editor and add:
echo "GROQ_API_KEY=your_groq_api_key_here" >> .env
echo "GROQ_TEXT_MODEL=auto" >> .env

# Optional (Call Assist - Deepgram live captions)
echo "DEEPGRAM_API_KEY=your_deepgram_api_key_here" >> .env

# Optional (Customize/Knowledge Base - Supermemory)
echo "SUPERMEMORY_API_KEY=your_supermemory_api_key_here" >> .env

Or manually create a .env file in the root folder with:

GROQ_API_KEY=your_groq_api_key_here
GROQ_TEXT_MODEL=auto
# Optional:
# GROQ_VISION_MODEL=meta-llama/llama-4-scout-17b-16e-instruct
# DEEPGRAM_API_KEY=your_deepgram_api_key_here
# SUPERMEMORY_API_KEY=your_supermemory_api_key_here

Step 4: Run the App

# Development mode (recommended for first run)
pnpm start

# Or build for production
pnpm run dist
# The built .dmg will be in the 'release' folder

macOS Keyboard Shortcuts

Shortcut Action
Cmd + Shift + Space Center and show the overlay
Cmd + B Toggle window visibility (show/hide)
Cmd + H Take screenshot for AI analysis
Cmd + K Open chat and focus input
Cmd + Enter Solve from screenshots / Debug with extra screenshots
Cmd + R Reset/Cancel current operation
Cmd + Arrow Keys Move window around screen
Cmd + Q Quit the application

macOS Permissions

On first run, you may need to grant permissions:

  1. Screen Recording: System Settings → Privacy & Security → Screen Recording → Enable for Clueless (required for screenshots; also used by Call Assist “Mic + System” mode)
  2. Microphone: System Settings → Privacy & Security → Microphone → Enable for Clueless (required for Call Assist)
  3. Accessibility (optional): System Settings → Privacy & Security → Accessibility → Enable for Clueless

🪟 Windows Installation & Setup

Step 1: Install Prerequisites

Option A: Using winget (Windows 11 / Windows 10 with winget)

# Open PowerShell as Administrator
winget install OpenJS.NodeJS.LTS
winget install Git.Git

# Restart PowerShell, then verify
node --version  # Should show v18.x.x or higher
pnpm --version
git --version

Option B: Manual Installation

  1. Download and install Node.js LTS from nodejs.org
  2. Download and install Git from git-scm.com
  3. Restart your terminal/PowerShell

Step 2: Clone and Install

# Open PowerShell or Command Prompt
git clone https://github.com/00-Aakash-00/clueless.git
cd clueless

# Install dependencies
pnpm install

# If you encounter build errors, try:
pnpm install --ignore-scripts
pnpm rebuild sharp

Step 3: Configure Environment

# Create .env file using PowerShell
New-Item -Path ".env" -ItemType File

# Add your API key (replace with your actual key)
Add-Content -Path ".env" -Value "GROQ_API_KEY=your_groq_api_key_here"
Add-Content -Path ".env" -Value "GROQ_TEXT_MODEL=auto"

# Optional
Add-Content -Path ".env" -Value "DEEPGRAM_API_KEY=your_deepgram_api_key_here"
Add-Content -Path ".env" -Value "SUPERMEMORY_API_KEY=your_supermemory_api_key_here"

Or manually create a .env file in the root folder with Notepad:

GROQ_API_KEY=your_groq_api_key_here
GROQ_TEXT_MODEL=auto
# Optional:
# GROQ_VISION_MODEL=meta-llama/llama-4-scout-17b-16e-instruct
# DEEPGRAM_API_KEY=your_deepgram_api_key_here
# SUPERMEMORY_API_KEY=your_supermemory_api_key_here

Step 4: Run the App

# Development mode (recommended for first run)
pnpm start

# Or build for production
pnpm run dist
# The built .exe installer will be in the 'release' folder

Windows Keyboard Shortcuts

Shortcut Action
Ctrl + Shift + Space Center and show the overlay
Ctrl + B Toggle window visibility (show/hide)
Ctrl + H Take screenshot for AI analysis
Ctrl + K Open chat and focus input
Ctrl + Enter Solve from screenshots / Debug with extra screenshots
Ctrl + R Reset/Cancel current operation
Ctrl + Arrow Keys Move window around screen

Windows Firewall

On first run, Windows Firewall may prompt you:

  • Click "Allow access" to let the app communicate with Groq's API

🐧 Linux Installation & Setup

Step 1: Install Prerequisites

Ubuntu/Debian:

# Update package list
sudo apt update

# Install Node.js (using NodeSource)
curl -fsSL https://deb.nodesource.com/setup_lts.x | sudo -E bash -
sudo apt install -y nodejs git

# Verify installation
node --version
pnpm --version

Fedora:

sudo dnf install nodejs npm git

Arch Linux:

sudo pacman -S nodejs npm git

Step 2: Clone and Install

git clone https://github.com/00-Aakash-00/clueless.git
cd clueless

# Install dependencies
pnpm install

# If you encounter Sharp errors:
SHARP_IGNORE_GLOBAL_LIBVIPS=1 pnpm install --ignore-scripts
pnpm rebuild sharp

Step 3: Configure Environment

# Create and edit .env file
echo "GROQ_API_KEY=your_groq_api_key_here" > .env
echo "GROQ_TEXT_MODEL=auto" >> .env
echo "DEEPGRAM_API_KEY=your_deepgram_api_key_here" >> .env      # optional
echo "SUPERMEMORY_API_KEY=your_supermemory_api_key_here" >> .env # optional

Step 4: Run the App

pnpm start

Linux Keyboard Shortcuts

Same as Windows - use Ctrl instead of Cmd.


🤖 AI Provider: Groq Cloud

Features:

  • Ultra-fast inference (fastest available)
  • Free tier available with generous limits
  • Vision model support (default: Llama 4 Scout)
  • Text models: auto, GPT-OSS 20B, GPT-OSS 120B (switchable in-app)

Getting Your API Key:

  1. Go to Groq Console
  2. Sign up or log in
  3. Click "Create API Key"
  4. Copy the key and add it to your .env file

Supported Models:

Model Description
auto Picks the best text model per request
openai/gpt-oss-20b Fast, efficient text model
openai/gpt-oss-120b Larger, more capable text model
meta-llama/llama-4-scout-17b-16e-instruct Vision model (auto-used for images)

🗣️ Call Assist (Deepgram)

Call Assist provides live captions and (optionally) suggested replies during a conversation.

Setup

  • Add DEEPGRAM_API_KEY to .env (required to start a session)
  • In the app: CallStart

Modes

  • Mic + System (2‑channel): captures your microphone + system audio (best results, requires screen/system-audio capture support)
  • Mic Only (fallback): captures only your microphone and uses Deepgram diarization

Notes

  • The app writes a local .wav recording to Electron’s user data directory (the full path is shown in the Call Assist panel).
  • If SUPERMEMORY_API_KEY is set and “Auto-save final turns to memory” is enabled, finalized turns can be stored in your knowledge base.

🧠 Personalization & Knowledge Base (Supermemory)

If you add SUPERMEMORY_API_KEY, the Customize panel unlocks:

  • Role presets (Meeting Assistant, Technical Expert, etc) + custom role prompt
  • Text context + user facts (persistent local + synced to LLM prompt)
  • “About You” entries (text or file) that influence responses
  • Knowledge base: upload documents, add URLs, add notes
  • Integrations: connect and sync Notion / Google Drive / OneDrive via Supermemory

Without SUPERMEMORY_API_KEY, the app still works — personalization features are simply disabled.


🔧 Troubleshooting

App Won't Start

Check if port 5180 is in use:

macOS/Linux:

lsof -i :5180
kill -9 <PID>  # Replace <PID> with the process ID

Windows:

netstat -ano | findstr :5180
taskkill /PID <PID> /F  # Replace <PID> with the process ID

Sharp/Python Build Errors

# Clean install
rm -rf node_modules pnpm-lock.yaml  # macOS/Linux
rmdir /s /q node_modules & del pnpm-lock.yaml  # Windows

# Reinstall with prebuilt binaries
SHARP_IGNORE_GLOBAL_LIBVIPS=1 pnpm install --ignore-scripts  # macOS/Linux
set SHARP_IGNORE_GLOBAL_LIBVIPS=1 && pnpm install --ignore-scripts  # Windows

pnpm rebuild sharp

Window Not Visible

Press Cmd/Ctrl + Shift + Space to center and show the overlay, or Cmd/Ctrl + B to toggle visibility. The window might be hidden or off-screen.

API Errors

  1. Verify your .env values are set and correct:
    • GROQ_API_KEY (required for all AI features)
    • DEEPGRAM_API_KEY (required for Call Assist)
    • SUPERMEMORY_API_KEY (required for Customize/Knowledge Base)
  2. Check you have API credits/permissions in the respective consoles
  3. Ensure you have internet connectivity

Closing the App

  • macOS: Press Cmd+Q (standard app shortcut) or use the tray/menu bar icon → Quit
  • Windows/Linux: Use the tray icon → Quit or click the red power icon in the top bar; use Task Manager to force close if needed

Key Features

Invisible AI Assistant

  • Translucent, always-on-top window that's barely noticeable
  • Hide/show instantly with global hotkeys
  • Content protection enabled (invisible to screen sharing on macOS)

Smart Screenshot Analysis

  • Take screenshots of any content with Cmd/Ctrl + H
  • AI analyzes images, documents, presentations, or problems
  • Get instant explanations, answers, and solutions

Contextual Chat

  • Chat with AI about anything you see on screen
  • Maintains conversation context
  • Ask follow-up questions for deeper insights

Call Assist (Live Captions + Suggestions)

  • Live transcription via Deepgram (mic + optional system audio)
  • Auto-suggests a reply to “their” turns (toggleable)
  • Optional auto-save of finalized turns into Supermemory

Personal Knowledge Base (Optional)

  • Upload documents and add notes/URLs as a knowledge base (Supermemory)
  • Connect Notion / Google Drive / OneDrive via Supermemory
  • Ground responses in your own materials when available

Debug Mode

  • Take additional screenshots after getting a solution
  • Press Cmd/Ctrl + Enter to debug
  • See side-by-side diff of old vs new code

Use Cases

Academic & Learning

  • Live presentation support during classes
  • Quick research during online exams
  • Language translation and explanations
  • Math and science problem solving

Professional Meetings

  • Sales call preparation and objection handling
  • Technical interview coaching
  • Client presentation support
  • Real-time fact-checking and data lookup

Development & Tech

  • Debug error messages instantly
  • Code explanation and optimization
  • Documentation and API references
  • Algorithm and architecture guidance

System Requirements

Minimum Recommended
RAM 4GB 8GB+
CPU Dual-core Quad-core
Storage 2GB 5GB+
OS macOS 10.15+, Windows 10, Ubuntu 20.04+ Latest versions

🤝 Contributing

This project welcomes contributions!

Ways to contribute:

  • Bug fixes and stability improvements
  • New features and AI model integrations
  • Documentation and tutorial improvements
  • Translations and internationalization
  • UI/UX enhancements

Star this repo if Clueless helps you succeed in meetings, interviews, or presentations!

Authors

  • Aakash Harish
  • Ameya Lambat

Tags

ai-assistant meeting-notes interview-helper presentation-support groq groq-cloud electron-app cross-platform open-source screenshot-analysis academic-helper sales-assistant coding-companion

About

cluely but open source

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages