Skip to content

v0.5.1

Choose a tag to compare

View all tags
@SStas SStas released this 03 Apr 06:49
· 10 commits to main since this release
v0.5.1
2f05ab6

v0.5.1 — Flexible Transfer Granularity

Added

  • output=PayloadType on think() — Controls what the returned context contains:
    • PayloadType.AUTO (default): system decides
    • PayloadType.KV_CACHE: full KV-cache + hidden state
    • PayloadType.HIDDEN_STATE: only last hidden state [1, D] (~14KB vs ~76MB, KV freed)
  • PayloadType.AUTO — SDK-only sentinel (-1), resolves at runtime, never serialized
  • AVPContext.payload_type property — Derived from data present
  • Same-model hidden state injection — generate() accepts hidden-state-only contexts for same-model (previously cross-model only)
  • Type validation for output= with actionable ConfigurationError

Removed

  • PayloadType.EMBEDDING — Removed from SDK and proto schema (dead code, never used)

Install

pip install avp==0.5.1

Full changelog: https://github.com/VectorArc/avp-python/blob/main/CHANGELOG.md

Assets 2
Loading