Is it possible/recommended to do open generation?

[LorrinWWW]

Thanks for sharing the great work!

I'm curious if it is appropriate to do open generation. E.g. put only [gMASK] at the beginning and then complete the text.

Thank you again!

[Sengxian]

Hello @LorrinWWW. GLM-130B can still generate fluent sentences in this scenario, you can also generate different sentences by changing the seed. However, we are not sure if it is appropriate, it maybe depends on what you want to do.

[LorrinWWW]

Thanks for your answer! Another question is do you have any suggestion on performing batch generation?

[Sengxian]

Currently we don't support batch generation, but I'm guessing it's not too hard to modify the autoregressive generation logic and its corresponding strategy in SAT to support batch generation with a fixed context length (or no context).

[LorrinWWW]

Thank you very much!