Way to mask multiple words in a sentence?

[vineeth567]

Hi,
Is there a way to mask multiple words in a sentence?

Thanks in advance.

[datquocnguyen]

Do you mean in training or inference phase?

[vineeth567]

Inference phase. Ex: How <mask> are <mask> How can i use the model to predict the above two masked words? While i'm giving this example to the sample code, it is throwing me an error like: only one word can be masked.

[datquocnguyen]

You might use a beam search to sequently predict each <mask> (from left to right) based on its unmasked context, e.g. first predicting How <mask> are, then How <1st_masked_candidate> are <mask>, How <2nd_masked_candidate> are <mask>, How <3rd_masked_candidate> are <mask>.