You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Project is excellent - thank you for releasing it.
When trying to use it with other LLMs, everything works via the docs.init method, but after pickling, setstate calls self.update_llm(None, None) which resets everything to OpenAI LLMs. This requires a valid OpenAI key to validate, as llm is None, so you create instances of ChatOpenAi, which attempts to validate the OPENAI_API_KEY.
I can after, unpicking, call docs.update_llm() again with an instance of the LLM I want to use, but the current pickle /restore is still dependent on that ChatOpenAI instantiation in the first place.
I can hack around it by setting an invalid OpenAI key in the environment, but that's a bit of a kludge.
The text was updated successfully, but these errors were encountered:
Project is excellent - thank you for releasing it.
When trying to use it with other LLMs, everything works via the docs.init method, but after pickling, setstate calls self.update_llm(None, None) which resets everything to OpenAI LLMs. This requires a valid OpenAI key to validate, as llm is None, so you create instances of ChatOpenAi, which attempts to validate the OPENAI_API_KEY.
I can after, unpicking, call docs.update_llm() again with an instance of the LLM I want to use, but the current pickle /restore is still dependent on that ChatOpenAI instantiation in the first place.
I can hack around it by setting an invalid OpenAI key in the environment, but that's a bit of a kludge.
The text was updated successfully, but these errors were encountered: