Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

When I use interpreter.chat(stream=True), in what scenarios will type return 'image'? #1301

Open
chasing1874 opened this issue Jun 9, 2024 · 1 comment

Comments

@chasing1874
Copy link

Describe the bug

When I use interpreter.chat(stream=True), in what scenarios will type return 'image'?

WeChat81712e215a2648b66051feea8cb3e107

When I try to use it in version 0.1.18, it returns image, but version 0.2.5 does not
like this:
v0.2.5
image

v0.1.18
image

v0.1.18 return the LMC msg with type = image, v0.2.5 type=console

I have set interpreter.computer.emit_images=True, but it doesn't seem to make any difference

Reproduce

none

Expected behavior

I wanna know in what case will type return 'image'?

Screenshots

No response

Open Interpreter version

0.2.5

Python version

3.10

Operating System name and version

macos

Additional context

No response

@chasing1874
Copy link
Author

Or when OI generates a chart using MatPlotLib I'm trying to find a way of saving it as a .png and returning the image path in the message thread so that I can display it in a tag on the frontend.
Ideally it would be returned like so: {"role": "assistant", "type": "image", "content": image_path}
How can I acheive this? Do I need to extend the Interpreter class with an extra method or can i achieve this through system prompt?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant