mercator scheme/rate-limiting/scheduling part of whirlpool project; handles crawler priority and politeness
-
Updated
Dec 14, 2021 - Java
mercator scheme/rate-limiting/scheduling part of whirlpool project; handles crawler priority and politeness
Add a description, image, and links to the mercator topic page so that developers can more easily learn about it.
To associate your repository with the mercator topic, visit your repo's landing page and select "manage topics."