Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Melody encoder and ornaments modeling #142

Closed
yqzhishen opened this issue Sep 15, 2023 · 4 comments · Fixed by #143
Closed

Melody encoder and ornaments modeling #142

yqzhishen opened this issue Sep 15, 2023 · 4 comments · Fixed by #143
Assignees

Comments

@yqzhishen
Copy link
Member

yqzhishen commented Sep 15, 2023

Melody encoder directly calculates attention on the note sequene besides the linguistic features. With this new method of melody modeling, the pitch predictor gains more sensitiveness on the pitch trend in the music scores, thus imroving accuracy and stability on short slurs, long vibratos and out-of-range notes. In addition, this note-level encoder can also accept ornament tags as input, for example, the glides.

@yakotoka
Copy link

Is this for the pitch model? Does pitch model training make use of this implementation or this is post pitch model creation? Thank you!

@yqzhishen
Copy link
Member Author

@yakotoka This is an improvement to the current pitch model, but models with and without melody encoder will not be compatible with each other.

@ghhcbef1
Copy link

ghhcbef1 commented Oct 11, 2023

openutau现在实现这个功能了吗?

@yqzhishen
Copy link
Member Author

@ghhcbef1 还没有,可能需要等一阵子

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging a pull request may close this issue.

3 participants