You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The program currently uses spaCy tokens to measure a prompt's size. This sometimes causes problems as there's no one-to-one correlation between spaCy tokens and GPT-2 tokens. Switching to using GPT-2 token lengths instead will resolve.
The text was updated successfully, but these errors were encountered:
The program currently uses spaCy tokens to measure a prompt's size. This sometimes causes problems as there's no one-to-one correlation between spaCy tokens and GPT-2 tokens. Switching to using GPT-2 token lengths instead will resolve.
The text was updated successfully, but these errors were encountered: