Skip to content

v0.2.2

Latest

Choose a tag to compare

@latenceainew latenceainew released this 05 May 18:44

Fixed

  • Preserve GLiNER shape-prefix metadata as float32 so bf16 pooling outputs do not round odd word counts above 256.
  • Prevent token-level GLiNER post-processing reshape failures in DeBERTa/ModernBERT GLiNER poolers.

Validation

  • python -m pytest /workspace/vllm-factory/test_shape_prefix.py -q
  • python -m ruff check /workspace/vllm-factory/vllm_factory/pooling/shape_prefix.py /workspace/vllm-factory/plugins/modernbert_gliner_rerank/pooler.py /workspace/vllm-factory/poolers/gliner.py /workspace/vllm-factory/plugins/deberta_gliner_linker/pooler.py /workspace/vllm-factory/test_shape_prefix.py

What's Changed

  • feat: add request affinity support for backend selection in multi-ins… by @srimon12 in #8
  • feat: enhance observability logging and schema caching in GLiNER2 pro… by @srimon12 in #9
  • fix(deberta_gliner2): support count_lstm_v2 / count_lstm_moe pooler variants by @MattThomas-fastino in #13
  • feat: widen deberta_gliner2 schema contract for per-field thresholds by @MattThomas-fastino in #10
  • feat: register DeBERTa backbones as SupportsLoRA targets by @MattThomas-fastino in #11
  • feat: wire per-request LoRA adapter through deberta_gliner2 IOProcessor by @MattThomas-fastino in #12
  • feat(dispatcher): log backend selection, affinity state, and schema size for GLiNER2 requests by @srimon12 in #14
  • Feat/gliner2 modernbert plugin by @Reterno12 in #16

New Contributors

Full Changelog: v0.2.1...v0.2.2