ramp-down function for loss weight

[jihwanp]

Hi, thanks for providing such nice work!
I have a minor question about the loss weight schedule.
For the consistency loss that you've designed, is there any experimental results that ramp-down weight scheduling affects the performance? Ramp-up seems plausible for stable training but I'm not sure why ramp-down needed.