Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speech animation, gaze tracking, face shape break with BabylonJS v5 #157

Open
Krxtopher opened this issue Feb 16, 2023 · 1 comment
Open
Labels
bug Something isn't working

Comments

@Krxtopher
Copy link
Contributor

Description:

If you attempt to use the Hosts with BabylonJS v5, audio and body animations work properly, but there is no speech animation, gaze tracking stops working, and the shape of the characters head (jaw, chin, and eyes especially) look odd (see attached images.)

Steps to Reproduce:

To reproduce:

  1. Clone the respository.
  2. Ensure you have branch “mainline2.0” checked out.
  3. Delete the package-lock.json file.
  4. Open the file /packages/amazon-sumerian-hosts-babylon/package.json for editing.
  5. Change the “peerDependencies” to the following:
"peerDependencies": {
    "@babylonjs/core": "^5.0.0",
    "@babylonjs/loaders": "^5.0.0"
  }
  1. From the root of the repository (important), run npm install
  2. Edit the /demo-credentials.js file to use a Cognito Identity Pool you’ve set up for use with Sumerian Hosts (see /AWS-Infrastructure-Setup.md for instructions if you don’t already have this set up.)
  3. From the root of the repository, run npm run start-babylon
  4. Once the browser tab titled “BabylonJS Sumerian Host Demo” loads, select the “Hello World Demo”.
  5. Click the “Start” button on the demo.
  6. Observe that the that audio plays but the host’s mouth doesn’t move and the host’s jawline/chin/eyes don't look right.

Expected:
Host w BJS v4 2 1

Actual:
Host w BJS v5 - front
Host w BJS v5 - profile

@Krxtopher Krxtopher added the bug Something isn't working label Feb 16, 2023
@trusktr
Copy link

trusktr commented Feb 17, 2024

duplicate of #155

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants