Skip to content

Fix token count memory leak

Choose a tag to compare

@MagMueller MagMueller released this 24 Jan 23:22
· 9604 commits to main since this release
9d2ace9
  • I am calculating the token count used, which is 80 MB per message for OpenAI. I have changed it to a simple estimate.