You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I suspect this is both for creating embeddings as well as prompting. Pre-tokenizing is one potential efficiency gain for prompts. Taking out stop words is another method that can shrink prompts down and save on tokens.
The text was updated successfully, but these errors were encountered:
I suspect this is both for creating embeddings as well as prompting. Pre-tokenizing is one potential efficiency gain for prompts. Taking out stop words is another method that can shrink prompts down and save on tokens.
The text was updated successfully, but these errors were encountered: