Skip to content

AbstractCore v2.26.3

Choose a tag to compare

View all tags
@github-actions github-actions released this 18 Oct 03:13
· 169 commits to main since this release
v2.26.3
83d5f6d

2.26.1 and 2.26.2 were not published on PyPI; their Windows fixes ship in this release.

Fixed

  • Hugging Face (transformers) prompt cache with transformers 5.20 or newer: a warm call
    feeds only the new part of the conversation again. transformers 5.20 removed Cache.crop
    with a positive length; the cache is now cropped with the negative form (drop that many
    tokens), which every supported transformers version accepts. With 5.20, every warm call
    re-read the whole conversation (correct output, no prefill savings).
Assets 4
Loading