-
Notifications
You must be signed in to change notification settings - Fork 118
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug] No debug context available when setting CE_DEBUG_INFO=true #297
Comments
@coreation I see you got unblocked in your own. |
@igiloh-pinecone no, unfortunately I'm not :) I'm running the code described in the ticket, but there's no context coming along, even though the chat response contains a properly formed answer. I'm now running copies of the code so that I can debug the entire RAG flow and see where it might go wrong |
Hi @coreation, is it possible to try to set CANOPY_DEBUG_INFO=true? We had added some more debug info to specific classes and decided to change the CE_DEBUG_INFO (CE meaning ContextEngine) to CANOPY_DEBUG_INFO to better reflect it is a project-wide config. |
hey @izellevy thanks, I'll give that a try, but it seems that I've got issues just getting a proper retrieval going. I'm running both the canopy REST API and the code mentioned in the ticket to compare things side by side. The environment variables are the same, but the custom code, based on what the library documentation mentions isn't able to generate anything given the same question. Using the REST API
Using the code mentioned in the ticket, based on the library.md file
I'm trying to wrap my head around what I'm doing wrong here... |
@izellevy @igiloh-pinecone the debug flag works... but the larger issue is that using the following code, does not deliver any kind of response, whereas the canopy REST API does, given the exact same configuration. If I look at the debug info, the documents that the KB retrieves are all...trash...just not relevant, while it's clear that by using the REST API endpoint on the same index does return information as it contains the sources that are in my index. Meaning, not something OpenAI can come up with.
Is there anything I should watch out for here? My goal (not unimportant :) ) is to capture all the used sources so that I can fetch more meta-data of those sources to use in the UI that our end-users see. |
@izellevy @igiloh-pinecone I'm going to make a dedicated issue out of the last comment as the original issue has been solved. |
Is this a new bug?
Current Behavior
Hello,
I want to use the context and knowledge base results of a chat_engine.chat execution. To do this, I've put the following in my .env file which i load using load_dotenv()
To confirm that this is read:
However, when I want to access the context, I get an empty object even though the response content contains a message based on RAG retrieval pieces, meaning there was a non-empty response.
Expected Behavior
I would expect to have access to the full context/kb results when setting the CE_DEBUG_INFO variable.
Steps To Reproduce
I think the notebook used in the "library" part of canopy has the basic steps, just add the CE_DEBUG_INFO variable and check for the debug context. I hope that will suffice :)
Relevant log output
No response
Environment
Additional Context
No response
The text was updated successfully, but these errors were encountered: