You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Or when OI generates a chart using MatPlotLib I'm trying to find a way of saving it as a .png and returning the image path in the message thread so that I can display it in a tag on the frontend.
Ideally it would be returned like so: {"role": "assistant", "type": "image", "content": image_path}
How can I acheive this? Do I need to extend the Interpreter class with an extra method or can i achieve this through system prompt?
Describe the bug
When I use interpreter.chat(stream=True), in what scenarios will type return 'image'?
When I try to use it in version 0.1.18, it returns image, but version 0.2.5 does not
![image](https://private-user-images.githubusercontent.com/60860201/337989373-eceb9c7a-b5f9-4d4a-a4e7-ee89ca360e51.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk0Mjc5NjAsIm5iZiI6MTcxOTQyNzY2MCwicGF0aCI6Ii82MDg2MDIwMS8zMzc5ODkzNzMtZWNlYjljN2EtYjVmOS00ZDRhLWE0ZTctZWU4OWNhMzYwZTUxLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI2VDE4NDc0MFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBhNmQzYjUyOTZmOWNkNGVmODk1OGU2MjZhMDhhMDgxMGNmNzM2YjhiODEwZDg4N2ZiZjUxOTBlYmE1YzRmNjUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.UB9C6NOhCeVWoIotIP_DoEk45w3Ui8lghtrv9IgNo2E)
like this:
v0.2.5
v0.1.18
![image](https://private-user-images.githubusercontent.com/60860201/337989401-5d563817-14f7-4a41-a4a3-41800e69f62d.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk0Mjc5NjAsIm5iZiI6MTcxOTQyNzY2MCwicGF0aCI6Ii82MDg2MDIwMS8zMzc5ODk0MDEtNWQ1NjM4MTctMTRmNy00YTQxLWE0YTMtNDE4MDBlNjlmNjJkLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI2VDE4NDc0MFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTE2MzljMTdlMGJkNzFhMzVmNTEyZDZiM2I5YWRiNDFmMTlmODkyNWJiZWExNzhmNzJlNDgxNzU5ZGE2MWY1YzYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.bIrFv_ICJ6XHRMXqBFqdfN-syEsvH0lQGwETFCkfHw4)
v0.1.18 return the LMC msg with type = image, v0.2.5 type=console
I have set interpreter.computer.emit_images=True, but it doesn't seem to make any difference
Reproduce
none
Expected behavior
I wanna know in what case will type return 'image'?
Screenshots
No response
Open Interpreter version
0.2.5
Python version
3.10
Operating System name and version
macos
Additional context
No response
The text was updated successfully, but these errors were encountered: