You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Masking is an essential part in LM models, so we need to have a layer to do the work.
Describe the solution you'd like
Create a new layer, which takes in sequence data (could be both RaggedTensor and Tensor), and returns masked sequence, and masked positions and ids.
Describe alternatives you've considered
We can directly use tf_text, but the API is not very user-friendly.
Additional context
N/A
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Masking is an essential part in LM models, so we need to have a layer to do the work.
Describe the solution you'd like
Create a new layer, which takes in sequence data (could be both RaggedTensor and Tensor), and returns masked sequence, and masked positions and ids.
Describe alternatives you've considered
We can directly use tf_text, but the API is not very user-friendly.
Additional context
N/A
The text was updated successfully, but these errors were encountered: