Skip to content

v0.1.1 - Auto Context Limiting

Choose a tag to compare

@Keyvanhardani Keyvanhardani released this 13 Jan 14:45
· 13 commits to master since this release

What's New

Bug Fixes

  • Auto context length limiting: Automatically limits context length to model's max_position_embeddings to prevent CUDA errors
  • Fixed GPT-2 with chat-agent profile crash

Improvements

  • Cleaner README with better explanation of why kvat exists
  • Details sections open by default
  • npm badge added

CI/CD

  • Auto-publish to npm when releasing
  • Version sync between pyproject.toml and package.json

Installation

pip install kvat[full]==0.1.1

Or npm:

npm install kvat@0.1.1