-
-
Notifications
You must be signed in to change notification settings - Fork 486
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Scrape results from Serper results using Olostep #627
Conversation
… results - The prompt isn't working great in actually extracting summary information from the target web pages, so this requires further investigation - Do some minor refactors to pass a symptom prompt to the openai model when making a query - integrate Olostep in order to perform the webscraping
Can we add chat actor, director tests to verify the functioning of this /online with website crawl flows? It's getting a little complicated. It'd be good to see what kind of stuff Khoj can do with this vs without it (It'll improve insight into our chatquality benchmarking via pytests) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This change will be super useful for deeper insights from online results! It'd be great if we can add some chat quality tests to evaluate Khoj's improved capabilities with these changes
answerBox
is present in the query results, no need to do the additional scraping