You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
These two lines are added when last_four_layers_embedding=True:
# cast layers to a tuple and concatenate over the last dimension
cat_hidden_states = torch.cat(tuple(last_four_layers), dim=-1)
# take the mean of the concatenated embedding vectors over the token dimension
text_embedding = torch.mean(cat_hidden_states, dim=1)
However, once you take the mean, how would you recover the original text from the embeddings produced?
The text was updated successfully, but these errors were encountered:
These two lines are added when
last_four_layers_embedding=True
:However, once you take the mean, how would you recover the original text from the embeddings produced?
The text was updated successfully, but these errors were encountered: