Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Live2D with Lipsync (using audio file/link) #122

Open
wants to merge 47 commits into
base: master
Choose a base branch
from
Open

Live2D with Lipsync (using audio file/link) #122

wants to merge 47 commits into from
+1,804 −1,617

Commits on Oct 6, 2023

  1. Added lip-sync module with audio 

    Changes:
1. updated model.motion(group, index, priority) to model.motion(group, index, priority, sound, volume, expression);
2. added model.stopSpeaking()
3. updated readme.MD with demos
4. Workflow will save files to dist (won't be gitignored)
5. Praying this new change doesn't break
    @RaSan147
    RaSan147 committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    99fd153 View commit details
    Browse the repository at this point in the history

  2. Automated report

    @RaSan147
    RaSan147 committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    d378339 View commit details
    Browse the repository at this point in the history

  3. Update index.js links

    @RaSan147
    RaSan147 committed Oct 6, 2023
    Configuration menu
    Copy the full SHA
    3ff3a53 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2023

  1. Update test.yml

    @RaSan147
    RaSan147 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    8539e76 View commit details
    Browse the repository at this point in the history

  2. Update test.yml

    @RaSan147
    RaSan147 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    cf0f4c4 View commit details
    Browse the repository at this point in the history

  3. Update test.yml

    @RaSan147
    RaSan147 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    f53e25a View commit details
    Browse the repository at this point in the history

  4. Fix Lip sync. Breaking change 

    voice volume expressions are now optional arg {name: value, ....}
    @RaSan147
    RaSan147 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    7deba12 View commit details
    Browse the repository at this point in the history

  5. Automated report

    @RaSan147
    RaSan147 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    06bfbd3 View commit details
    Browse the repository at this point in the history

  6. Update README.md and added video

    @RaSan147
    RaSan147 committed Oct 12, 2023
    Configuration menu
    Copy the full SHA
    1e89254 View commit details
    Browse the repository at this point in the history

Commits on Dec 7, 2023

  1. Merge branch 'master' into master

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    34831e8 View commit details
    Browse the repository at this point in the history

  2. Fix type error on ci test

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2d0c512 View commit details
    Browse the repository at this point in the history

  3. clear dist, using workflow to get output files

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2617eae View commit details
    Browse the repository at this point in the history

  4. removed Version number

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    de764a1 View commit details
    Browse the repository at this point in the history

  5. Now supports other b64 audio

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    2877f47 View commit details
    Browse the repository at this point in the history

  6. Remove audio url validation

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    25ddef6 View commit details
    Browse the repository at this point in the history

  7. rename speakUp -> speak

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    b4a394a View commit details
    Browse the repository at this point in the history

  8. rename resetMotions -> stopMotions

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    6f3a779 View commit details
    Browse the repository at this point in the history

  9. return false when audio play fails

    @RaSan147
    RaSan147 committed Dec 7, 2023
    Configuration menu
    Copy the full SHA
    e878d79 View commit details
    Browse the repository at this point in the history

Commits on Dec 13, 2023

  1. Added crossorigin for speak voice source

    @RaSan147
    RaSan147 committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    031ca86 View commit details
    Browse the repository at this point in the history

  2. Place missing CrossOrigin arg

    @RaSan147
    RaSan147 committed Dec 13, 2023
    Configuration menu
    Copy the full SHA
    ae1c923 View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2023

  1. Update MotionManager.ts

    @RaSan147
    RaSan147 committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    c0cb7f5 View commit details
    Browse the repository at this point in the history

  2. Update readme as per PR

    @RaSan147
    RaSan147 committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    c8eca3f View commit details
    Browse the repository at this point in the history

  3. Check any base64 data for audio 

    Co-authored-by: Guan <46285865+guansss@users.noreply.github.com>
    @RaSan147 @guansss
    RaSan147 and guansss committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    7f8ec7a View commit details
    Browse the repository at this point in the history

  4. Remove autoplay attr from audio 

    Co-authored-by: Guan <46285865+guansss@users.noreply.github.com>
    @RaSan147 @guansss
    RaSan147 and guansss committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    06d7255 View commit details
    Browse the repository at this point in the history

  5. Remove cache blocker. 

    Co-authored-by: Guan <46285865+guansss@users.noreply.github.com>
    @RaSan147 @guansss
    RaSan147 and guansss committed Dec 14, 2023
    Configuration menu
    Copy the full SHA
    96a6f82 View commit details
    Browse the repository at this point in the history

Commits on Dec 30, 2023

  1. remove wav only blob condition 

    also remove cache buster and autoplay
    @RaSan147
    RaSan147 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    9fc5a21 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'guansss:master' into for_PR

    @RaSan147
    RaSan147 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    b005f73 View commit details
    Browse the repository at this point in the history

  3. RAN npm run lint:fix

    @RaSan147
    RaSan147 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    ff1a588 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'for_PR' of https://github.com/RaSan147/pixi-live2d-display 

     into for_PR
    @RaSan147
    RaSan147 committed Dec 30, 2023
    Configuration menu
    Copy the full SHA
    0495f5b View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2024

  1. fix startmotion, getting error

    @RaSan147
    RaSan147 committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    1cd47d6 View commit details
    Browse the repository at this point in the history

  2. All test passed. Everything OK

    @RaSan147
    RaSan147 committed Feb 9, 2024
    Configuration menu
    Copy the full SHA
    65f31e2 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2024

  1. revert: undo unexpected changes

    @guansss
    guansss committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    92af59b View commit details
    Browse the repository at this point in the history

  2. fix: model.speak() not returning true on success

    @guansss
    guansss committed Feb 28, 2024
    Configuration menu
    Copy the full SHA
    b00b64b View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. feat: extract lip sync code to LipSync class

    @guansss
    guansss committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    b511d74 View commit details
    Browse the repository at this point in the history

  2. test: fix broken test procedure

    @guansss
    guansss committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    12e9530 View commit details
    Browse the repository at this point in the history

  3. test: add lip sync test

    @guansss
    guansss committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    ee42229 View commit details
    Browse the repository at this point in the history

  4. chore: fix failing npm install

    @guansss
    guansss committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    6f3cd68 View commit details
    Browse the repository at this point in the history

Commits on Apr 1, 2024

  1. feat: skip lip sync analyzer when no audio is playing

    @guansss
    guansss committed Apr 1, 2024
    Configuration menu
    Copy the full SHA
    40cd3f3 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. fix: model.motion() parameters should be optional

    @guansss
    guansss committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    638053e View commit details
    Browse the repository at this point in the history

  2. feat: default lip sync id for cubism 4 models

    @guansss
    guansss committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    9a9d20f View commit details
    Browse the repository at this point in the history

  3. feat: make options.crossOrigin also work for audios

    @guansss
    guansss committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    2ecdb53 View commit details
    Browse the repository at this point in the history

  4. test: add aborted lip sync test

    @guansss
    guansss committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    9cb5c38 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2024

  1. test: make lip sync test more stable

    @guansss
    guansss committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    f53509b View commit details
    Browse the repository at this point in the history

  2. test: make lip sync test more stable (for real)

    @guansss
    guansss committed Apr 14, 2024
    Configuration menu
    Copy the full SHA
    d69a771 View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. feat: merge lipSync.analyze() into lipSync.getValue()

    @guansss
    guansss committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    94a7ea1 View commit details
    Browse the repository at this point in the history

  2. test: temporarily disable parallelism to fix random failures

    @guansss
    guansss committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    87476a4 View commit details
    Browse the repository at this point in the history

  3. revert: remove updateFacialEmotion method

    @guansss
    guansss committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    718215d View commit details
    Browse the repository at this point in the history