Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DuckDuckGo Answer Generator not working #4

Open
SandNerd opened this issue Sep 29, 2016 · 3 comments
Open

DuckDuckGo Answer Generator not working #4

SandNerd opened this issue Sep 29, 2016 · 3 comments

Comments

@SandNerd
Copy link

Repro Steps

  1. Create an engine soley for DuckDuckGo as in here
  2. Either:
  • Within the engine page use Try it out with any query (e.g. ocr)
  • Further set Active by default? and Use for reference? both to true, save engine and use SolveForAll upper search box with any query

Expected: Top results from DuckDuckGo to be shown on search page
Actual: No results from DuckDuckGo. Only mentions Try your search on: DuckDuckGo at the top

Enviornment

  • Browser: Firefox 50.0b2
  • OS: linux 4.4.0-39-generic
@jtsay362
Copy link
Owner

Hi,

Unfortunately, you have experienced the expected behavior. There are two issues that prevent you from getting what you expect:

  1. Normally, URI template answer generators such as the DuckDuckGo one only produce links to the search page. However, it is possible to have Solve for All fetch the search page and extract the relevance links by enabling "Deep Search".
  2. Unfortunately, DuckDuckGo doesn't all scraping of its results and as a search engine that also respects user privacy, I feel it would be unethical to do so. Other sites (mostly e-commerce sites) are scrapable though. Try this URL if you are curious:

https://solveforall.com/answers.do?q=logitech+mouse&type=answers&engines=107

and enable "Deep Search". Then reload (sorry). I'm still fleshing out this feature, but this should give you a preview. Thanks for trying out Solve for All!

@SandNerd
Copy link
Author

I'd say then that all non-scrapable sources (for whatever reason) should be their own category of sort to notify the user.

@jtsay362
Copy link
Owner

jtsay362 commented Oct 3, 2016

Good suggestion. Many of the non-scrapable sources are in the "Search" category, but that includes scrapable ones as well. In the future, I'll be added a label that indicates that a source is scrapable or not and I think this should be satisfactory to you. When that is done, I will close this issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants