Repology link checker
This is a standalone link validity checker daemon for Repology project.
It operates on
links table in Repology PostgreSQL database, which
contains homepage and download URLs of F/OSS projects extracted from
packages by Repology, taking URLs from there, checking their validity
and accessibility via both IPv4 and IPv6 and writes the status back.
asynciobased, which means it doesn't require a lot of resources, but still can process a lot of links in parallel
- it takes most care to not generate excess load on servers by maintaining per-host queues and adding delays between consequential requests to a single host
- (TODO) checks link availability via both IPv4 and IPv6
- (TODO) capable of FTP link checking
GPLv3 or later, see COPYING.