Skip to content

0.11.0

Choose a tag to compare

View all tags
@philipnorton42 philipnorton42 released this 24 Feb 22:18
· 27 commits to main since this release
0.11.0
4df169c
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Changes:

  • #10 Added the ability to parse robots.txt files and add the links found to the exclusion rules.
Assets 2
Loading