Skip to content

Latest commit

 

History

History
executable file
·
21 lines (16 loc) · 948 Bytes

tokens.rst

File metadata and controls

executable file
·
21 lines (16 loc) · 948 Bytes

Token usage

Input tokens

The application features a token calculator. It attempts to forecast the number of tokens that a particular query will consume and displays this estimate in real time. This gives you improved control over your token usage. The app provides detailed information about the tokens used for the user's prompt, the system prompt, any additional data, and those used within the context (the memory of previous entries).

Remember that these are only approximate calculations and do not include, for example, the number of tokens consumed by some plugins. You can find the exact number of tokens used on the OpenAI website.

image

Total tokens

After receiving a response from the model, the application displays the actual total number of tokens used for the query (received from the API).

image