A small Node.js benchmark suite for the tiktoken WASM port.
-
Updated
May 29, 2023 - TypeScript
A small Node.js benchmark suite for the tiktoken WASM port.
📐 GPT token estimation and context size utilities without a full tokenizer
Add a description, image, and links to the tiktoken topic page so that developers can more easily learn about it.
To associate your repository with the tiktoken topic, visit your repo's landing page and select "manage topics."