Terminal tool gives `ValueError: Could not parse LLM output:` when there is a new libe before action string. #3365

My- · 2023-04-22T22:04:26Z

While playing with the LLaMA models I noticed what parse exception was thrown even output looked good.

Screenshot

For curious one the prompt I used was:

agent({"input":"""
There is a file in `~/.bashrc.d/` directory containing openai api key.
Can you find that key?
"""})

My- · 2023-04-22T22:05:11Z

I have a fix. Will create PR shortly.

Changed regex to cover new line before action serious. regex101: https://regex101.com/r/CXl1kB/1

…3367) Fix for: [Changed regex to cover new line before action serious.](#3365) --- This PR fixes the issue where `ValueError: Could not parse LLM output:` was thrown on seems to be valid input. Changed regex to cover new lines before action serious (after the keywords "Action:" and "Action Input:"). regex101: https://regex101.com/r/CXl1kB/1 --------- Co-authored-by: msarskus <msarskus@cisco.com>

…n serious (langchain-ai#3367) Fix for: [Changed regex to cover new line before action serious.](langchain-ai#3365) --- This PR fixes the issue where `ValueError: Could not parse LLM output:` was thrown on seems to be valid input. Changed regex to cover new lines before action serious (after the keywords "Action:" and "Action Input:"). regex101: https://regex101.com/r/CXl1kB/1 --------- Co-authored-by: msarskus <msarskus@cisco.com>

My- mentioned this issue Apr 22, 2023

[Fix #3365]: Changed regex to cover new line before action serious #3367

Merged

My- pushed a commit to My-/langchain that referenced this issue Apr 22, 2023

Fix langchain-ai#3365 + test

9d17c72

Changed regex to cover new line before action serious. regex101: https://regex101.com/r/CXl1kB/1

hwchase17 closed this as completed in a4d85f7 Apr 25, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Terminal tool gives `ValueError: Could not parse LLM output:` when there is a new libe before action string. #3365

Terminal tool gives `ValueError: Could not parse LLM output:` when there is a new libe before action string. #3365

My- commented Apr 22, 2023

My- commented Apr 22, 2023

Terminal tool gives ValueError: Could not parse LLM output: when there is a new libe before action string. #3365

Terminal tool gives ValueError: Could not parse LLM output: when there is a new libe before action string. #3365

Comments

My- commented Apr 22, 2023

Screenshot

My- commented Apr 22, 2023

Terminal tool gives `ValueError: Could not parse LLM output:` when there is a new libe before action string. #3365

Terminal tool gives `ValueError: Could not parse LLM output:` when there is a new libe before action string. #3365