This library has been deprecated. Please see this page for information about the latest Concrete Gigaword ingester.
If starting a project using Concrete and Gigaword, please use the above link to the main concrete-java project.
Library to take Gigaword documents and convert them to Concrete Communication objects.
<dependency>
<groupId>edu.jhu.hlt</groupId>
<artifactId>concrete-gigaword</artifactId>
<version>4.4.0</version>
</dependency>Create converter object:
ConcreteGigawordDocumentFactory factory = new ConcreteGigawordDocumentFactory();SGML .gz file to Iterator<Communication>:
Path gzPath = Paths.get("path/to/sgml/file.gz");
Iterator<Communication> iter = factory.iterator(gzPath);
while (iter.hasNext()) {
Communication c = iter.next();
// process c
}See GIGAWORD.md for instructions about how to reproduce the Concrete representation of English Gigaword v5, one of the data sets described in the publication Concretely Annotated Corpora.
Apache 2