Skip to content

1.2.3 Improved entity parsing

Choose a tag to compare

@fmacpro fmacpro released this 16 Sep 22:03
· 15 commits to master since this release
a397cc7
  • Rewrite the entity parser to strip trailing job titles, split dense acknowledgement sequences, merge optional secondary NER results, and refine deduping, exposing the async pipeline through the article parser.
  • Extend NLP plugin hints to cover middle names, suffixes, and secondary NER configuration, update the default hint shape, and document the new options for integrators.
  • Preserve spacing when unwrapping inline HTML wrappers and add regression coverage for the helper to prevent merged tokens in cleaned articles.
  • Expand entity parser regression tests for the new heuristics and raise language suite timeouts to keep the browser-driven checks stable.
  • Overhauled the entity parser with heuristics that trim job titles, split dense acknowledgement blocks, incorporate secondary NER responses, and dedupe results asynchronously within the article pipeline.
  • Broadened NLP plugin hint handling—including default options—to accept middle/suffix buckets and external NER sources, and updated the README to describe the configuration.
  • Ensured inline wrapper removal leaves readable spacing and added targeted tests for the helper alongside broader entity parser and language timeout coverage.