Archivindex Builder

This is the primary repository for the Archivindex Builder project, which has been supported by Prototype Fund.

About

aib-core: Representations of entries, snapshots, etc.
aib-cdx: Client for accessing CDX index APIs
aib-cdx-store: Local store for CDX index data
aib-store: Local store for archive snapshots
aib-downloader: Client for downloading archive snapshots
aib-downloader-cli: Minimal command-line interface for downloading archive snapshots (for use in environments where compiling the entire project is undesirable)
aib-extractor: Library for extracting indexable documents from snapshots
aib-indexer: Full-text index for snapshots, built on Tantivy
aib-manager: Pipelines for operations involving multiple data sources
aib-cli: Command-line interfaces for management operations
aib-auth: Interfaces for managing user authentication
aib-auth-sqlx: SQLx implementation for managing user authentication
aib-service: JSON web service providing search API, built on Rocket
redirects: Miscellaneous tools for working with Wayback Machine redirects

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
.github/workflows		.github/workflows
.sqlx		.sqlx
app		app
auth-sqlx		auth-sqlx
auth		auth
cdx-store		cdx-store
cdx		cdx
cli		cli
core		core
downloader-cli		downloader-cli
downloader		downloader
extractor		extractor
images		images
indexer		indexer
manager		manager
redirects		redirects
service		service
store		store
.gitignore		.gitignore
Cargo.lock		Cargo.lock
Cargo.toml		Cargo.toml
LICENSE		LICENSE
README.md		README.md