v0.2.1
What's Changed
Native GLiNER2 schema extraction with labels backward compat (#4)
- Support both
schema(priority) andlabels(normalized to{"entities": labels}) input contracts - Six task types: entities, relations, classification, json_structures, entity_groups, mixed schemas
- New request parameters:
threshold,include_confidence,include_spans
Request contract tightening — overflow handling, threshold, model prep (#5)
- Token overflow handling:
max_model_lenenforcement with optionaltruncate_overflow_text - Threshold filtering applied to classification results (raw logits)
- Robust error handling in model preparation with actionable messages
- Request contract documentation with JSON payload examples
Request-side preprocessing caching (#6)
- LRU caching for tokenization, special token IDs, and schema preprocessing
- ~33% latency reduction on repeated requests with identical schemas
Full Changelog: v0.2.0...v0.2.1
What's Changed
- Add native GLiNER2 schema extraction support to vLLM pooling by @srimon12 in #4
- Tighten GLiNER2 request contract by @srimon12 in #5
- Adds request-side caching to the deberta_gliner2 by @srimon12 in #6
New Contributors
Full Changelog: v0.2.0...v0.2.1