Skip to content
This repository was archived by the owner on Sep 28, 2025. It is now read-only.

v0.1.12

Choose a tag to compare

View all tags
@mtasic85 mtasic85 released this 16 Aug 12:31
· 118 commits to main since this release
v0.1.12
ba5a3a9

Added:
- Build vulkan_1_x for general GPU.
- Build cuda 12.4.1 as default.

Changed:
- Renamed examples for TinyLlama (chat, tool calling) and OpenAI.
- Updated demo models definitions.
- Updated examples (chat, tool calling).
- get_special_tokens not supports parameter force_standard_special_tokens: bool=False which bypasses tokenizer's special tokens with standard/common ones.
- Build cuda 12.5.1 as additional build target but packaged on PyPI.
- Build cuda 12.6 as additional build target but packaged on PyPI.
- Build openblas as additional build target but packaged on PyPI.

Fixed:
- Handle Options.no_display_prompt on Python side.

Assets 20
Loading