New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Perform token length checking in %%assist #57

Merged

rgbkrk merged 2 commits into main from token-checking

Mar 18, 2023

Owner

rgbkrk commented Mar 18, 2023

Use tiktoken to calculate the estimated tokens
Remove the oldest messages until we're under the token limit
test it!

I cleaned up some of the pandas specific context gathering as well and tested that too.


          check on tokens

aeeda44

rgbkrk force-pushed the token-checking branch from 8bb2246 to aeeda44 Compare

March 18, 2023 06:06


          update the changelog

f3c773f

rgbkrk merged commit bbb9dfe into main

rgbkrk deleted the token-checking branch

March 18, 2023 15:17

rgbkrk mentioned this pull request

Prepare 2.0.0 release #68

Merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment