Skip to content

Releases: ayzekhdawy/pointhand

PointHand v0.2.0 Alpha 3

Pre-release

Choose a tag to compare

@ayzekhdawy ayzekhdawy released this 16 Oct 22:33

PointHand v0.2.0-alpha.3

An alpha for supervised Windows workflows. This download adds covered-window capture and the computer-use behavior that landed in source after Alpha 2.

Highlights

  • A window screenshot uses that window's own pixels when Windows graphics capture is available, including while another window covers it. The image is labeled capture: window and does not raise the window. If window capture is unavailable, the image is labeled capture: visible and may raise the window. Desktop and monitor screenshots stay the visible composite.
  • Pointer actions bring the target window forward and stop when a different window still covers the point. Typing and activate_window still focus the target. A new action still waits until the pointer has been idle. A started action continues through mouse movement; physical Escape and emergency_stop cancel it.
  • screenshotId binds a click, drag, scroll, or move to one bounded region. A window that crosses monitors, each monitor screenshot, and an owned popup has its own id and screen origin.

Validation and limits

Windows CI runs Rust, TypeScript, helper and native protocol checks, builds the executable, extracts the ZIP and verifies checksums, the executable manifest and isolated MCP startup. Local host tests and client tests passed. On one display, a covered probe window kept its own color and was not brought forward by the screenshot.

Secure-desktop switching, display disconnection during input, additional physical monitor combinations and clean non-developer-PC startup remain to verify. This capture check did not use a second physical monitor. See the validation checklist.

Install

Download the Windows x64 ZIP and .sha256 companion. Verify with Get-FileHash -Algorithm SHA256, extract, install Node.js 20+ and configure your MCP client with the absolute extracted client/dist/index.js path. Rust/Python are not needed for the main portable server. Use POINTHAND_ALLOW to restrict apps and supervise the session. Restart a running PointHand so it loads this executable.

Join in

Code, documentation, creative examples and compatibility reports are welcome in Turkish or English. Read CONTRIBUTING.md and browse good first issues or help wanted.

The application components retain their 0.2.0 base version; the Git tag identifies this alpha distribution. Alpha 2 and Alpha 1 remain available unchanged.

PointHand v0.2.0 Alpha 2 — Community Preview

Choose a tag to compare

@ayzekhdawy ayzekhdawy released this 16 Oct 08:15

PointHand v0.2.0-alpha.2

A community-focused alpha for supervised Windows creative workflows. This release brings the source improvements after Alpha 1 into the portable download.

Highlights

  • 26 MCP tools, including out-of-band emergency_stop: active input and queued mutations stop until the server restarts.
  • Per-monitor bounds/effective DPI and window DPI diagnostics; pixel-center mapping fixes one-pixel pointer/stroke drift.
  • Independent overlay frame pacing, real foreground validation and periodic active-desktop checks during input.
  • Turkish/English Paint selectors and custom name mappings; reproducible Mona Lisa script, public video and GIF.
  • Contribution guide, issue/PR templates and beginner-friendly community tasks.

Validation and limits

Windows CI runs Rust, TypeScript, helper and native protocol checks, builds the executable, extracts the ZIP and verifies checksums, the executable manifest and isolated MCP startup. Live PointHand tests covered a 125% primary display and 100% virtual secondary streamed through Sunshine, left/right placement, held-button emergency cancellation and real physical-mouse intervention.

Observed mixed-DPI overlay timings were approximately 57–59 FPS at a 60 FPS target. This is not a guaranteed display refresh rate. Secure-desktop switching, display disconnection during input, additional physical monitor combinations and clean non-developer-PC startup remain to verify. See the validation checklist.

Install

Download the Windows x64 ZIP and .sha256 companion. Verify with Get-FileHash -Algorithm SHA256, extract, install Node.js 20+ and configure your MCP client with the absolute extracted client/dist/index.js path. Rust/Python are not needed for the main portable server. Use POINTHAND_ALLOW to restrict apps and supervise the session.

Join in

Code, documentation, creative examples and compatibility reports are welcome in Turkish or English. Read CONTRIBUTING.md and browse good first issues or help wanted.

The application components retain their 0.2.0 base version; the Git tag identifies this alpha distribution. Alpha 1 remains available unchanged.

PointHand v0.2.0 Alpha 1

Pre-release

Choose a tag to compare

@ayzekhdawy ayzekhdawy released this 15 Oct 18:27

PointHand'in ilk herkese açık alpha sürümü, @ayzekhdawy hesabından yayımlanmıştır.

PointHand, yaratıcı ve işlevsel Windows iş akışları için TypeScript MCP istemcisi ve yerel Rust sunucusunu birleştirir. Paint ve Illustrator'da gerçek fare girdisiyle çizim, UI Automation, klavye, scroll, ekran görüntüleri ve yerel overlay sunar.

İndir ve çalıştır

  1. Windows x64 ZIP dosyasını ve .sha256 dosyasını indirin.
  2. PowerShell Get-FileHash -Algorithm SHA256 ile ZIP özetini karşılaştırın.
  3. ZIP'i çıkarın. Node.js 20+ gereklidir; Node.js 22 LTS önerilir. Rust ve Python kurulumu gerekmez.
  4. MCP istemcinizde node komutunu, çıkarılan client/dist/index.js dosyasının tam yoluyla yapılandırın. README'de örnek yapılandırma vardır.

Bu sürümde

  • 25 MCP aracı ve gerçek Windows fare/klavye girdileri.
  • Yerel Rust overlay; canlı testte yaklaşık 60 FPS.
  • Yumuşak hızlanma/yavaşlama, tam hedef koordinatları ve kademeli scroll.
  • Uygulama izin listesi, fiziksel müdahale takibi, Escape ile durdurma ve iptal sırasında tuş/fare bırakma.
  • Mona Lisa referansı, Paint sonucu, sessiz demo videosu ve tekrar kullanılabilir çizim betiği.
  • Windows derleme ve test iş akışı; ZIP için SHA-256 özeti.
  • Derleme bilgisayarının kullanıcı yolları yayın dosyasından temizlenmiştir.

Alpha sınırları

Gözetimli kullanım içindir. Çoklu monitör, farklı DPI ve uzun işlem müdahale senaryolarında ek doğrulama gereklidir. Gerçek fareyle çizimde uygulamanın girdiyi alması gerekir; örtülü pencereye arka planda çizim desteklenmez. Paint örneğinin UI seçicileri Türkçe arayüz gerektirir. İnsan girdisinden ayırt edilemezlik veya her uygulamada kusursuz çalışma garantisi verilmez.

Kaynak: https://github.com/ayzekhdawy/pointhand

Mona Lisa yönergesi: https://github.com/ayzekhdawy/pointhand/tree/main/examples/mona-lisa