Tool to extract web pages from warc.gz and write content documents. Each line of file is composed by one document.
#How to use
$ python warcParser.py PATH_DATASET INITIAL_FILE_COUNTER
anderson-pids/misc-warc_extractor
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Tool to extract web pages from warc.gz and write content documents. Each line of file is composed by one document.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published