Skip to content

Desktop App v0.3.1 (superseded by v0.3.2)

Choose a tag to compare

View all tags
@Iyanuoluwa007 Iyanuoluwa007 released this 12 Aug 12:21
· 13 commits to main since this release
desktop-v0.3.1
354ff11

Superseded. Download Desktop App v0.3.2 instead. In this build the 3D canvas could cover the buttons and stop them being clicked.

Signs what your whole computer is saying, not just your browser tabs. It reads Windows 11 Live Captions, which transcribes system audio, so it works with video calls, media players and any other desktop application.

All downloads

Product Platform Version File
Desktop App Windows 11 v0.3.1 Signlytic AI Setup 0.3.1.exe (99 MB)
Desktop App macOS upcoming not yet available
Chrome Extension Chrome v0.3.6 signlytic-extension.zip (23 MB)

New in v0.3.1

"Start Live Captions" now actually starts them. It opens Windows Live
Captions for you if it is not already running, then begins signing. Before
this it only waited for a window you had to open yourself from a second
button, which is not what the label promised. If Live Captions is already
open it is left alone rather than being re-triggered.

The signer keeps its place. It always sits directly below the title bar
and above the controls, and no longer collapses when the window is made
small. The window now has a minimum size for the same reason.

From v0.3.0

It overlays your desktop instead of sitting in a window. Transparent and
frameless, always on top, drawn as a translucent panel.

Five placements. Snap it into any corner, or leave it floating and put it
wherever you like. Corners keep the panel roughly portrait, which is the
shape a signing avatar needs. Your choice is remembered between runs.

The caption reader survives failures. It no longer stops on a transient
Windows UI Automation hiccup, restarts itself if it does stop while captions
are meant to be running, and reports a readable reason instead of a bare exit
code. This is the fix for "sidecar exited (code 4294770688)" seen in v0.2.0.

Installing

Run the installer. It is unsigned, so Windows SmartScreen will warn on first
run: choose More info, then Run anyway.

What it does

  • Windows 11 Live Captions read live and signed as they are spoken
  • 2D skeleton renderer (default) and 3D avatar renderer
  • Manual text entry, so it is usable without captions
  • Sentences queue rather than cutting each other off mid-sign
  • Words with no sign in the dictionary are fingerspelled rather than skipped

Requirements

  • Windows 11 22H2 or later, for Live Captions. The first time Live Captions
    opens, Windows asks you to accept terms and download a speech model. That
    is a one-off Windows step and cannot be done for you.
  • An internet connection: gloss translation and sign data are fetched from
    the Signlytic API.

Known limitations

  • In 3D mode the hands currently sit lower than they should. 2D is the
    default and is unaffected.
  • No system tray or auto-start yet.

macOS

The Mac app is upcoming. The app itself already runs on macOS through manual
text entry; what is missing is caption capture, because macOS exposes
captions through the Accessibility API rather than the interface used on
Windows, which needs a separate signed helper and explicit permission.

Assets 3
Loading