fix flaky test

ampc shortest path test case

approximate centrality progress bar

[ampc] ability to send requests without timeouts (should be used spar…

use shortest paths as subroutine in approx centrality

support WARC-Date in .warc files

optional max distance in shortest paths

optimise shortest path to use exact changed nodes (stored in hashset)…

combine sketches across workers for more precise bloom filters

bellman-ford inspired shortest path for distributed graph. works bett…

Improve code docs (#246)

document main crawler elements

document generic search query flow

document the different searchers

document ranking pipeline

document ampc framework

document all entrypoints

document supported search operators (#245)

document supported search operators

update documentation links

just update

Improve architecture documentation (#243)

update webgraph docs

update search index docs

update crawler docs

cleanup assets