Skip to content

pointcast 0.1.0 — public beta

Pre-release
Pre-release

Choose a tag to compare

@Hugelidus Hugelidus released this 27 Sep 16:58
· 32 commits to main since this release

Narrate UI changes while you point at your web app. Your coding agent gets the exact elements, and the code behind them.

This is the first public release, a beta: Chrome on desktop, developed and tested on Windows. Feedback and bug reports are very welcome in the issues.

Install

  1. Extension: download pointcast-0.1.0-chrome.zip below and unzip it. In Chrome, open chrome://extensions, turn on Developer mode, choose Load unpacked and pick the unzipped folder.
  2. Claude Code (optional): the plugin fetches your latest recording and applies it with /pointcast, resolving each element to its line in your repository.
    claude plugin marketplace add Hugelidus/pointcast
    claude plugin install pointcast@pointcast
  3. CLI and MCP server (optional, Node ≥ 22.12): npx pointcast --help. Other MCP clients (Cursor, Windsurf): see the CLI's README.

Turn off Chrome's Ask where to save each file before downloading (chrome://settings/downloads): with it on, Chrome asks where to save every file of every recording, and the sessions miss Downloads/pointcast/, where the plugin and the CLI look for them.

What it does

  • Record your voice while you Alt+click or select the elements you are talking about. On local dev hosts out of the box; on any other site after you enable it, one host at a time.
  • Stop, and a few seconds later the spec is on your clipboard: Whisper runs locally in the browser while you record, and each sentence you said becomes a request with the elements you pointed at while saying it.
  • Point at the code: on React, Vue 3 and Svelte 5 dev builds, each element leads with where that instance is used and the line of its text or data, with the source line quoted. Nothing is added when a match is ambiguous.
  • Private by default: audio and transcription stay on your machine, sensitive fields are never captured, and personal data is redacted on non-local sites.

Known limitations

  • Chrome only (no Firefox yet).
  • The code pointer needs a dev build of React, Vue 3 or Svelte 5; Angular and other frameworks get the DOM description only.
  • Code lines on the clipboard need a Vite dev server. With webpack or Next.js, the plugin, the MCP server and pointcast process still resolve them in your local repository.
  • The first recording downloads the Whisper model (291 MB, once).

Full changelog: CHANGELOG.md.