Skip to content

Signlytic AI v1.0.0

Choose a tag to compare

View all tags
@Iyanuoluwa007 Iyanuoluwa007 released this 12 Aug 12:25
· 69 commits to main since this release
v1.0.0
55e3b37

First tagged release of the Signlytic AI system: the source of record for everything shipped so far, across the website, the Chrome extension, the desktop app and the local translation pipeline.

What is in this release

Website (live)

https://signlytic-ai-website.vercel.app

  • BSL translation layer across the site. Hovering or focusing a wrapped
    sentence highlights it and offers playback; clicking anywhere on it plays
    the translation. 40 signable sentences across the home, demo and extension
    pages.
  • One shared player per page rather than an avatar per sentence, with 2D
    skeleton by default and a 3D avatar on demand, so the default path
    downloads neither the WebGL engine nor a large model.
  • Site-wide on/off toggle, persisted per visitor.
  • API routes: English to glosses, glosses to English, per-gloss sign data,
    and avatar model delivery.

Chrome extension v0.3.6

Detects live captions on YouTube, BBC iPlayer, Netflix and more and signs
them in a floating panel.

Download: https://github.com/Iyanuoluwa007/Signlytic-Overlay/releases/tag/v0.3.6

Desktop app v0.3.1 (Windows beta)

Reads Windows 11 Live Captions and signs whatever the computer is saying, in
any application. Transparent always-on-top overlay with corner or floating
placement.

Download: https://github.com/Iyanuoluwa007/Signlytic-Overlay/releases/tag/desktop-v0.3.1

Translation pipeline

  • Video-SWIN-T sign recognition over 5,203 BSL signs
  • Gloss to English assembly with Cerebras primary and Groq as fallback
  • Coqui XTTS v2 speech synthesis
  • 2D skeleton and 3D avatar animation from pose frames

Notable engineering in this release

  • The 2D renderer, the 3D avatar engine, the pose normaliser and the gloss
    converter are shared: the extension's overlay/ folder is the single
    source of truth, and the website and desktop app sync from it rather than
    keeping their own copies.
  • Caption text is normalised before it drives anything. The Live Captions
    buffer is a rolling window that is revised in place after the fact, so
    sentences are only released once they settle.
  • Sign data is served through a proxy that keeps the access token
    server-side and adds the CORS header GitHub's asset hosts do not send.

Known limitations

  • In 3D mode the avatar's hands sit lower than they should. 2D is the
    default everywhere and is unaffected.
  • macOS caption capture is not built. The desktop app runs on macOS through
    manual text entry, but macOS exposes captions through a different system
    interface that needs a separate signed helper.
  • Desktop installers are unsigned, so Windows SmartScreen warns on first run.

Downloads

This repository is private, so its release assets are not publicly
downloadable. Public downloads live on the overlay repository:
https://github.com/Iyanuoluwa007/Signlytic-Overlay/releases

Assets 2
Loading