The power of GitHub Copilot, now with visual-spatial awareness and advanced automation.
GitHub Copilot-Liku CLI brings AI-powered coding assistance and UI automation directly to your terminal. This "Liku Edition" extends the standard Copilot experience with an ultra-thin Electron overlay, allowing the agent to "see" and interact with your screen through a coordinated grid system and native UI automation.
See our official documentation or the Liku Architecture for more information.
We're bringing the power of GitHub Copilot coding agent directly to your terminal, enhanced with Liku's visual awareness. Work locally and synchronously with an AI collaborator that understands your code AND your UI state.
- Unified Intelligence: Combines terminal-native development with visual-spatial awareness.
- Ultra-Thin Overlay: A transparent Electron layer for high-performance UI element detection and interaction.
- Multi-Agent Orchestration: A sophisticated Supervisor-Builder-Verifier pattern for complex, multi-step task execution.
- Liku CLI Suite: A comprehensive set of automation tools (
click,find,type,keys,screenshot) available from any shell. - Defensive AI Architecture: Engineered for minimal footprint ($<300$MB memory) and zero-intrusion workflows.
The liku command is your entry point for visual interaction and automation. It can be used alongside the standard copilot command.
liku start
# or simply
likuThis launches the Electron-based visual agent including the chat interface and the transparent overlay.
| Command | Usage | Description |
|---|---|---|
click |
liku click "Submit" --double |
Click UI element by text or coordinates. |
find |
liku find "Save" --type Button |
Locate elements using native UI Automation / OCR. |
type |
liku type "Hello World" |
Input string at the current cursor position. |
keys |
liku keys ctrl+s |
Send complex keyboard combinations. |
window |
liku window "VS Code" |
Focus a specific application window. |
screenshot |
liku screenshot |
Capture the current screen state for analysis. |
repl |
liku repl |
Launch an interactive automation shell. |
- Chained Automation:
liku window "Notepad" && liku type "Done!" && liku keys ctrl+s - Coordinate Precision:
liku click 500,300 --right - JSON Processing:
liku find "*" --json | jq '.[0].name'
Liku perceives your workspace through a dual-mode interaction layer.
- Passive Mode: Fully click-through, remaining dormant until needed.
- Dot-Grid Targeting: When the agent needs to target a specific point, it generates a coordinate grid (Coarse ~100px or Fine ~25px) using alphanumeric labels (e.g.,
A1,C3.21). - Live UI Inspection: Uses native accessibility trees (Windows UI Automation) to highlight and "lock onto" buttons, menus, and text fields in real-time.
Ctrl+Alt+Space: Toggle the Chat Interface.Ctrl+Alt+F: Toggle Fine Grid (Precise targeting).Ctrl+Alt+I: Toggle Inspect Mode (UI Element highlighting).Ctrl+Shift+O: Toggle Overlay Visibility.
The Liku Edition moves beyond single-turn responses with a specialized team of agents:
- Supervisor: Task planning and decomposition.
- Builder: Code implementation and file modifications.
- Verifier: Phased validation and automated testing.
- Researcher: Workspace context gathering and info retrieval.
/orchestrate <task>: Start full multi-agent workflow./research <query>: Execute deep workspace/web research./build <spec>: Generate implementation from a spec./verify <target>: Run validation checks on a feature or UI./agentic: Toggle Autonomous Mode (Allow AI actions without manual confirmation).
- Node.js v22 or higher
- npm v10 or higher
- (On Windows) PowerShell v6 or higher
- An active Copilot subscription.
Install globally from npm:
npm install -g copilot-liku-cliThis will make the liku command available globally from any directory.
To verify installation:
liku --versionTo update to the latest version:
npm update -g copilot-liku-cliTo install the Liku Edition for local development and contributing:
git clone https://github.com/TayDa64/copilot-Liku-cli
cd copilot-Liku-cli
npm install
npm linkThis will make the liku command available globally, linked to your local development copy.
Note for contributors: Use npm link during development so changes are immediately reflected without reinstalling.
If you're not logged in, launch the agent and use the /login slash command, or set a personal access token (PAT):
- Visit GitHub PAT Settings
- Enable "Copilot Requests" permission.
- Export
GH_TOKENorGITHUB_TOKENin your environment.
GitHub Copilot-Liku CLI is built on a "Defensive AI" architecture—a design philosophy focused on minimal footprint, secure execution, and zero-intrusion workflows.
Engineered for performance and stability, the system hits the following metrics:
- Memory Footprint: $< 300$MB steady-state (~150MB baseline).
-
CPU Usage:
$< 0.5%$ idle;$< 2%$ in selection mode. -
Startup Latency:
$< 3$ seconds from launch to functional state.
- Hardened Electron Environment: Uses
contextIsolationandsandboxmodes to prevent prototype pollution. - Content Security Policy (CSP): Strict headers to disable unauthorized external resources.
- Isolated Preload Bridges: Secure IPC routing where renderers only have access to necessary system APIs.
See docs/inspect-overlay-plan.md for the inspect overlay plan and acceptance criteria.
- Installation Guide - Detailed installation instructions for all platforms
- Quick Start Guide - Get up and running quickly
- Contributing Guide - How to contribute to the project
- Publishing Guide - How to publish the package to npm
- Release Process - How to create and manage releases
- Architecture - System design and architecture
- Configuration - Configuration options
- Testing - Testing guide and practices
We're excited to have you join us early in the Copilot CLI journey.
This is an early-stage preview, and we're building quickly. Expect frequent updates--please keep your client up to date for the latest features and fixes!
Your insights are invaluable! Open issue in this repo, join Discussions, and run /feedback from the CLI to submit a confidential feedback survey!