This repository was archived by the owner on May 8, 2024. It is now read-only.

v0.4.6

ninpnin released this 22 Sep 08:25

9247c22

What's Changed

New features

Implement BERT classification of paragraph type
Rewrite protocol formatting and cleaning script
Implement conversion of manually annotated data into JSON

Bug fixes

Fix false positive in tests
Fix word merging regex upstream in the download pipeline
Do not rely on data source page order for page numbers

Test coverage

Verify that text content matches the original altofiles

Merged pull requests

Create an example file for manual curation storage by @ninpnin in #178
ALTO to parlaclarin pipeline fixes by @ninpnin in #190
Store information on manually curated parts of the corpus by @ninpnin in #192
v0.4.6 by @ninpnin in #194

Full Changelog: v0.4.5...v0.4.6

Contributors

ninpnin

Assets 3