- Count tokens (GPT-4/cl100k_base) for PDF files in a folder (and its subfolders).
- A price estimate for my own personal reasons.
- I needed a tool to count tokens for lots of PDFs.
- Tool works smoothly, so I'm sharing.
PySimpleGUI
fitz
tiktoken
- Personal use: Yes - humans can use and modify the code freely. No limits.
- Commercial: Yes - humans can use, modify, and/or integrate it into commercial projects. No limits.
- AI agents and bots: No - can't read or use my code.