What is the role of WU

[zhanglei1172]

Hello, I have two doubts reading your code. 1. what is the variable WU in the VAE code? I noticed that it is assigned by warmup and will increase from 0 to 1 as the epoch increases. Means that the weight of the likelihood gradually decreases with training? Is there any consideration behind this?

SIVI/SIVAE.py

Line 126 in c457d09

loss_iw0 = -tf.reduce_logsumexp(log_lik_iw+(log_prior_iw-log_H_iw)*WU,1)+tf.log(tf.cast(K,tf.float32))

2.One more question about this loss, I noticed that there is a batch count multiplier missing. Is that right？

Thanks!