Skip to content

v0.2.1

Choose a tag to compare

@ddickmann ddickmann released this 13 Apr 07:36

What's Changed

Native GLiNER2 schema extraction with labels backward compat (#4)

  • Support both schema (priority) and labels (normalized to {"entities": labels}) input contracts
  • Six task types: entities, relations, classification, json_structures, entity_groups, mixed schemas
  • New request parameters: threshold, include_confidence, include_spans

Request contract tightening — overflow handling, threshold, model prep (#5)

  • Token overflow handling: max_model_len enforcement with optional truncate_overflow_text
  • Threshold filtering applied to classification results (raw logits)
  • Robust error handling in model preparation with actionable messages
  • Request contract documentation with JSON payload examples

Request-side preprocessing caching (#6)

  • LRU caching for tokenization, special token IDs, and schema preprocessing
  • ~33% latency reduction on repeated requests with identical schemas

Full Changelog: v0.2.0...v0.2.1

What's Changed

  • Add native GLiNER2 schema extraction support to vLLM pooling by @srimon12 in #4
  • Tighten GLiNER2 request contract by @srimon12 in #5
  • Adds request-side caching to the deberta_gliner2 by @srimon12 in #6

New Contributors

Full Changelog: v0.2.0...v0.2.1