Pinned Loading
Repositories
Showing 10 of 16 repositories
- chatnoir-ir-datasets-indexer Public
- chatnoir-chat Public
- chatnoir-warc-dl Public
This pipeline allows extracting data from WARC files on a CPU cluster and streaming it to a GPU server, where it is processed.