Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

teacher model's inputs should be z * scale + mu ? #2

Open
xuerq opened this issue Mar 10, 2018 · 2 comments
Open

teacher model's inputs should be z * scale + mu ? #2

xuerq opened this issue Mar 10, 2018 · 2 comments

Comments

@xuerq
Copy link

xuerq commented Mar 10, 2018

If I understand correctly . teacher model's inputs should be z * scale + mu ?
https://github.com/zhf459/P_wavenet_vocoder/blob/master/train_student.py#L303

@zhf459
Copy link
Owner

zhf459 commented Mar 12, 2018

@xuerq

student_predict = np.random.logistic(mu, scale)
p_s = probs_logistic(mu, scale, student_predict)
p_s = Variable(torch.from_numpy(p_s).float()).cuda().permute(0, 2, 1)
# input student sample to evaluate probability
student_predict = Variable(torch.from_numpy(student_predict).float()).cuda()
y_hat = teacher(student_predict)  # y_hat: (B x C x T) teacher: 10-mixture-logistic

sorry for replying late,I think z * scale + mu , z sample from logistic(0,1) and so it seems the same as logistic(mu, scale).

@xuerq
Copy link
Author

xuerq commented Mar 12, 2018

It's a little bit different I think
When calculating H(ps(xt | x<t), Pt(xt|x<t)) , “x<t” is fixed。That means,z should be fixed。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants