Skip to content

Chrome Extension v0.4.1 - The 3D avatar actually signs now

Choose a tag to compare

@Iyanuoluwa007 Iyanuoluwa007 released this 19 Aug 10:19
· 1 commit to main since this release

If you use the 3D avatar, update. If you only use the 2D skeleton, nothing here
changes for you: the 2D renderer was always correct and is untouched.

The 3D avatar was placing hands in the wrong place

Its hands sat near the hips and barely moved, whatever the sign was. Three
separate faults in the 3D path, none of them in the sign data itself:

  • The forearm was positioned against the wrong reference, inheriting a rotation
    from the upper arm that had already been applied. Isolated on the rig, the
    upper arm was exact while the forearm came out 72 degrees off whenever the
    arm moved. The forearm carries the hand, so that alone decided where every
    hand went.
  • Arms were aimed rather than solved. Pointing a bone along a captured direction
    takes the limb LENGTH from the avatar, so the hand could only reach as far as
    the avatar's own arm allowed, which is shorter than the captured one. The
    wrist is now solved to its target position, with the captured elbow deciding
    which way the arm bends.
  • Two different definitions of where the torso ends were being mixed, which left
    every hand slightly high.

Measured against the 2D renderer over 818,904 solves from 500 signs, since 2D
plots the captured points directly and is the picture that was already right.
Median error dropped from 0.434 to 0.003 of torso length, and the worst tenth
from 0.737 to 0.010. Just as important, the hand now travels the same range as
the reference instead of sitting in a narrow band at hip height.

Fingerspelling improved as a side effect. The same fault compounded down each
finger, curling them; fingers now extend to 0.83 of their natural span rather
than 0.66.

The female avatar had never moved

Not in this release or any before it. Her rig names its bones with a different
prefix to the male one, and the code assumed a single prefix for both. Nothing
failed loudly: she loaded, reported herself ready, and stood still through every
sign. The prefix is now read from the avatar. Both now animate.

Unchanged

The 192 bundled signs are byte for byte identical to v0.4.0. Only the manifest
and the 3D renderer differ.

Install

Download signlytic-extension.zip, unzip, open chrome://extensions, enable
Developer Mode, and Load Unpacked on the unzipped folder. If v0.4.0 is already
loaded, remove it first.

Attribution

Signlytic AI, by Oke Iyanuoluwa Enoch. If you use, fork or build on this project,
please credit the project and link back to this repository.