Releases: mobilint/vllm-mblt
Releases · mobilint/vllm-mblt
Release list
v0.2.2
What's Changed
- Report pinned memory as unavailable on MbltPlatform (fixes red main and the v0.2.1 release gate) by @beomsu-mobilint in #13
- Bump version to 0.2.2 by @beomsu-mobilint in #14
Full Changelog: v0.2.1...v0.2.2
v0.2.1
What's Changed
- Address mxq serving sanity findings: live cache prefix invariants, sampling penalties, auto core mode by @beomsu-mobilint in #11
- CI: run pytest and ruff on every pull request by @beomsu-mobilint in #12
Full Changelog: v0.2.0...v0.2.1
v0.2.0
What's Changed
- VLM prefix caching 범위 정리 및 runtime cache 안정화 by @beomsu-mobilint in #9
- Batch VLM 서빙 지원 추가 by @beomsu-mobilint in #10
Full Changelog: v0.1.6...v0.2.0
v0.1.6
What's Changed
- Fix non-batch NPU prompt echo logprobs by @beomsu-mobilint in #8
Full Changelog: v0.1.5...v0.1.6
v0.1.5
What's Changed
- Fix batch prompt logprobs for last-logit MXQ by @beomsu-mobilint in #7
Full Changelog: v0.1.4...v0.1.5
v0.1.4
What's Changed
- Fix concurrent prompt logprobs for MBLT V1 by @beomsu-mobilint in #6
Full Changelog: v0.1.3...v0.1.4
v0.1.3
What's Changed
- Fix completion prompt and generated logprobs by @beomsu-mobilint in #5
Full Changelog: v0.1.2...v0.1.3
v0.1.2
What's Changed
- Refactor Mobilint runtime KV cache management by @beomsu-mobilint in #3
- completion echo prompt logprobs 오류 수정 by @beomsu-mobilint in #4
Full Changelog: v0.1.1...v0.1.2
v0.1.1
What's Changed
- Beomsu/add max num seqs warning by @beomsu-mobilint in #1
- Update mblt-model-zoo to 2.1.0 by @beomsu-mobilint in #2
New Contributors
- @beomsu-mobilint made their first contribution in #1
Full Changelog: v0.1.0...v0.1.1