Summary:
This release primarily consists of dependency updates rather than direct modifications to the crawler software itself.
Small note on the data:
The procedure for postprocessing data has been modified as per issues #255 and #259. These changes have been retroactively applied to all previously collected datasets and will continue to be applied to all future data collection.
To pull the exact image versions used in this release:
docker pull ghcr.io/privacy-tech-lab/crawl-driver@sha256:1598e2e5aa30595fcf51b074555f6fed780c959bd7350592a3a8334aee06861e
docker pull ghcr.io/privacy-tech-lab/well-known-crawl@sha256:0afe15b29d26a36baf64147f2ab87588e808e59fc82b980a92778daa0f3a35e8
docker pull ghcr.io/privacy-tech-lab/rest-api@sha256:5dd1d885d5995f93707e600c99fba7c7c4e0f38f443d6a19e168d75344c00885
docker pull ghcr.io/privacy-tech-lab/mariadb-custom@sha256:5556b4e63a1fa0674d3617bf652bcc75b66ee991ece8f4f978170573c6272999