codes of VLP

[EddieKro]

Hi!
Thank you for the amazing work on LaBERT! I was wondering whether you would release the code for Length-Controllable VLP. In case I try my own implementation, adding length-level embedding to an input word embedding will suffice? Am I right?
BTW, where can I find weights for length-aware VLP or AoANet?
Thanks!

[bearcatt]

In case I try my own implementation, adding length-level embedding to an input word embedding will suffice?

Yes, that's it.

release the code/model for Length-Controllable VLP

It's ok for us to release the code/model, but you may need to wait for a while. You can first try to implement it yourself.

[EddieKro]

Thanks for the reply, will be waiting for the weights!