Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Integrate DHT crawler to search the whole BitTorrent DHT network #609

Closed
mx5kevin opened this issue Nov 10, 2023 · 1 comment
Closed

Integrate DHT crawler to search the whole BitTorrent DHT network #609

mx5kevin opened this issue Nov 10, 2023 · 1 comment
Labels
crawler enhancement Indicates new feature requests or improvement for existing functionality

Comments

@mx5kevin
Copy link

Project:

https://btdig.com/

https://github.com/btdig/dhtcrawler2

https://en.wikipedia.org/wiki/BTDigg

There is a search engine with which users can search the whole BitTorrent DHT network decentralized way but its running in a centralized server. It would be useful for everyone if we integrate it to prevent the project from becoming unavailable when the central server goes down. Everyone should have an easy-to-run web interface on their computer.

@okybaca okybaca added enhancement Indicates new feature requests or improvement for existing functionality crawler labels Nov 11, 2023
@Orbiter
Copy link
Member

Orbiter commented Dec 3, 2023

It's maybe better to use a specialized search service for specialized protocols. YaCy wants to support http/https primary and there are few exceptions to sources that can also be accessed by a web browser, like ftp and file paths. It might be tempting but no.

@Orbiter Orbiter closed this as completed Dec 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
crawler enhancement Indicates new feature requests or improvement for existing functionality
Projects
None yet
Development

No branches or pull requests

3 participants