Skip to content

v1.6.4

Choose a tag to compare

@kgruiz kgruiz released this 03 Feb 23:05
· 28 commits to main since this release

This update improves token count aggregation in directory and file processing, ensuring accurate and structured JSON output.

Key Updates & Enhancements

Improved Token Count Aggregation

  • GetNumTokenDir now includes a "numTokens" key at the top level, correctly summing all files and subdirectories while respecting the recursive parameter.
  • GetNumTokenFiles properly propagates mapTokens when processing directories, ensuring accurate aggregation of "numTokens" for nested structures, also following the recursive parameter logic.