Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Issue]: Warning from the def _num_token_from_messages is verbose and hard to silence #2538

Closed
colaso96 opened this issue Apr 28, 2024 · 2 comments · Fixed by #2225
Closed
Assignees

Comments

@colaso96
Copy link

colaso96 commented Apr 28, 2024

Describe the issue

Here is an example output:
[I 2024-04-27 00:02:01,357.357 autogen.token_count_utils] gpt-4 may update over time. Returning num tokens assuming gpt-4-0613.

However, this is very verbose and frustrating to see printed. Can we either dynamically retrieve the number of tokens from the model count or toggle this output? I can work around it but it seems like a fixable bit of code.

Steps to reproduce

Initialize a compressible agent or series of compressible agents

Screenshots and logs

Screenshots in comment

Additional Information

No response

@colaso96
Copy link
Author

Screenshot 2024-04-28 at 7 56 20 PM

@colaso96 colaso96 changed the title [Issue]: Warning from token count is verbose and I would like to silence in some way [Issue]: Warning from the def _num_token_from_messages is verbose hard to silence Apr 29, 2024
@colaso96 colaso96 changed the title [Issue]: Warning from the def _num_token_from_messages is verbose hard to silence [Issue]: Warning from the def _num_token_from_messages is verbose and hard to silence Apr 29, 2024
@WaelKarkoub WaelKarkoub self-assigned this Apr 29, 2024
@WaelKarkoub
Copy link
Collaborator

Hi @colaso96! We are deprecating compressible agents in favor of TransformMessages https://microsoft.github.io/autogen/docs/topics/long_contexts/. I'm implementing llmlingua as a new transform in #2225 to compress text.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants