Skip to content

ReDefiNER 1.0.6

Choose a tag to compare

@Jungroo-AI Jungroo-AI released this 01 Nov 19:15
· 23 commits to main since this release

Define what counts as an entity. Run it locally. A 0.8B model that extracts and labels exact spans using your plain-English rulebook.

pip install redefiner

Weights: jungroo-ai/redefiner-0.8b · Demo: jungroo-ai/redefiner-demo · Benchmarks · Changelog

Same weights. Same outputs as 1.0.5, except label(..., snap=True) on a span that ends with a space or is only whitespace.

Label mode

  • snap=True trims spaces from both ends of a span before widening it to whole tokens. Before, a span with a trailing space was widened into the next token: "Ada Lovelace " became "Ada Lovelace correspond", and could get a different label. With snap=True, a span of only whitespace now comes back unsupported.
  • The docs say what snapping does and doesn't do: it widens a span to whole tokens, not words, so a snapped span can still end inside a word ("Ada Lo" becomes "Ada Lov"), and part of a word that starts and ends on token boundaries is labeled as given, with no flag. Also in the label docstring and llms.txt.

PyPI page

  • Images show and links work: every README link is absolute, and a test keeps it that way.

Docs

  • The headline gives each gap: about 5 F1 behind Claude Haiku 5.5 (73.1) and 4.3 behind Gemini 3.1 Pro (72.4) on CrossNER AI.
  • The key-value tables have column headers. Limits say what long texts mean: each part is read on its own, so labels can differ across a document. The Release row separates the weights (1.0) from the package (1.0.6).
  • CHANGELOG.md, also linked from PyPI.

Package and CI

  • Python 3.14 is tested in CI and listed on PyPI.
  • The weekly model tests run with the pinned transformers and with the newest release, so a transformers change that breaks the model code shows up before the pin is widened.
  • The Development section downloads the model files without the benchmark outputs and images.