JoshBot v1.0.0
JoshBot v1.0.0 is the first supported release of the Joshternet discovery, verification, and public registry crawler.
What JoshBot does
- Crawls independently verified Joshternet origins and operator-curated seeds.
- Follows same-origin pages through a bounded breadth-first crawler.
- Turns external public links into independent verification candidates.
- Verifies declarations at
/.well-known/josh. - Stores verification, queue, lease, seed, and discovery state in PostgreSQL.
- Produces deterministic public registry snapshots.
- Publishes exact registry trees through an isolated GitHub API runtime.
Links create candidates. Valid declarations create participants.
Crawler identity
JoshBot uses the HTTP User-Agent Joshternet-Joshbot (+https://joshternet.org/joshbot).
Crawler behavior, retained data, non-archival behavior, resource limits, and robots controls are documented at:
https://joshternet.org/joshbot
Security and operations
JoshBot validates resolved network destinations, guards redirects, enforces robots policy, bounds response processing, and isolates database credentials from publication credentials.
The Docker Compose deployment includes migration, verification, discovery, export, publication, backup, restore, and recovery workflows.
Reporting problems
Unexpected crawler behavior can be reported here:
https://github.com/joshternet/joshbot/issues/new?template=crawler_report.yml
Software defects can be reported here:
https://github.com/joshternet/joshbot/issues/new?template=bug_report.yml
Security vulnerabilities must be reported privately:
https://github.com/joshternet/joshbot/security/advisories/new
Documentation
- Project documentation: https://github.com/joshternet/joshbot
- Joshternet specifications: https://github.com/joshternet/spec
- Changelog: https://github.com/joshternet/joshbot/blob/v1.0.0/CHANGELOG.md
- Deployment guide: https://github.com/joshternet/joshbot/blob/v1.0.0/deploy/README.md
JoshBot is licensed under the BSD 3-Clause License. Copyright belongs to Joshua Morris.