Repository navigation
🚀 What's New?
TokenSpan now offers a simple API that analyzes a text file containing your prompt and estimates whether it would benefit from dictionary compression. It identifies repeated phrases, calculates potential token savings, and helps you decide whether applying the compression technique is worthwhile before making any changes.