Web Archive Discovery

These are the components we use to data-mine and index our ARC and WARC files and make the contents explorable and discoverable.

Documentation

See the wiki.

Name		Name	Last commit message	Last commit date
Latest commit History 943 Commits
configs		configs
digipres-tika		digipres-tika
documentation		documentation
solr-shade		solr-shade
warc-discovery-shine		warc-discovery-shine
warc-hadoop-crawler-utils		warc-hadoop-crawler-utils
warc-hadoop-indexer		warc-hadoop-indexer
warc-hadoop-recordreaders		warc-hadoop-recordreaders
warc-indexer		warc-indexer
warc-solr-test-server		warc-solr-test-server
.gitattributes		.gitattributes
.gitignore		.gitignore
.travis.yml		.travis.yml
CHANGES.md		CHANGES.md
README.md		README.md
TODO.md		TODO.md
pom.xml		pom.xml
update_shine.sh		update_shine.sh