Skip to content

v0.8.0

Choose a tag to compare

@proycon proycon released this 14 Jun 21:31

This is a first release after the split from PICCL. Introduces a renewed Nederlab pipeline consisting of the following components (most can be enabled/disabled when needed):

  • Conversion from TEI to FoLiA through tei2folia (part of FoliA tools, this replaces the old scripts by Erik Tjong Kim Sang.
  • FoLiA v2 compatible, stricter and explicit validation and explicit provenance information.
  • Tokenisation through ucto
  • Language detection using folialangid (part of FoliA tools)
  • Linguistic enrichment through Frog (part-of-speech tagging, lemmatisation, named entity recognition)
  • Named Entity Linking (after another recognition stage) is handled by wikiente, which communicates with the DBPedia Spotlight service, and replaces the older foliaentity tool by Erwin Komen.