Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support of visualization #141

Merged
merged 11 commits into from
Feb 23, 2024
Merged

Add support of visualization #141

merged 11 commits into from
Feb 23, 2024

Conversation

lmxue
Copy link
Collaborator

@lmxue lmxue commented Feb 21, 2024

✨ Description

We release the Visualization Tool, a unique feature in Amphion, designed to visually analyze classical audio, music, and speech generation models for educational purposes. It offers an interactive experience for beginners, engineers, and researchers alike, enabling them to explore and understand the inner workings of generative models.

Currently, Amphion supports a visualization tool of the diffusion model for singing voice conversion, named SingVisio. The paper of SingVisio: Visual Analytics of the Diffusion Model for Singing Voice Conversion is available now. Additionally, SingVisio tool can be experienced here.

SingVisio Demo

SingVisio_Demo.mp4

🚧 Related Issues

#124

πŸ‘¨β€πŸ’» Changes Proposed

  • Add a README.md file in the egs/visualization directory to introduce Amphion's visualization feature.
  • Add a README.md file in the egs/visualization/SingVisio directory to introduce SingVisio.
  • Integrate web-based user interface of SingVisio to the Amphion/visualization/SingVisio directory.

πŸ§‘β€πŸ€β€πŸ§‘ Who Can Review?

@yuantuo666 @RMSnow

πŸ›  TODO

None

βœ… Checklist

  • Code has been reviewed
  • Code complies with the project's code standards and best practices
  • Code has passed all tests
  • Code does not affect the normal use of existing features
  • Code has been commented properly
  • Documentation has been updated (if applicable)
  • Demo/checkpoint has been attached (if applicable)

README.md Outdated Show resolved Hide resolved
README.md Show resolved Hide resolved
egs/visualization/SingVisio/README.md Show resolved Hide resolved
README.md Outdated Show resolved Hide resolved
egs/visualization/SingVisio/README.md Outdated Show resolved Hide resolved
imgs/visualization/SingVisio_system.png Outdated Show resolved Hide resolved
Copy link
Collaborator

@RMSnow RMSnow left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Re-check all the copyright information for newly added files. Replace them with Amphion's if necessary. Others look good to me.

@lmxue lmxue requested a review from RMSnow February 23, 2024 13:01
@RMSnow RMSnow merged commit d37d8f1 into open-mmlab:main Feb 23, 2024
1 check passed
ArkhamImp pushed a commit to ArkhamImp/Amphion that referenced this pull request Apr 17, 2024
Release the first visualization tool of Amphion, SingVisio
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants