Release v0.2.1
v0.2.1 Patch Release
This patch improves SimaLMM packaging reliability and concurrent request handling for LLiMa deployments.
What changed
SimaLMM now exports cleaner CMake package metadata. The installed SimaLMM::sima_lmm_runtime target no longer exposes build-machine or sysroot-specific include paths. Instead, it points downstream projects at package-relative include directories that are valid after installation.
This release also isolates the prepared MLA request queue per request thread. Concurrent GenAI requests for different served models no longer share one process-global queue before submission to mlashmcomplex.
A small chat prompt handling issue was also fixed so system prompts are stored as plain text consistently across chat templates.
Why this matters
Before this patch, downstream projects could inherit include paths from the machine or sysroot that built the package. That made installed-package builds more fragile, especially when consuming SimaLMM from a different DevKit, SDK, or clean build environment.
The shared request queue also created risk for concurrent model-serving workloads. Requests from different threads or served models could interact through shared client-side queue state. With thread-local queue state, each request path keeps its own prepared MLA queue until it is submitted.
User benefit
- More reliable downstream builds that consume the installed SimaLMM CMake package.
- Cleaner package behavior across DevKit and SDK environments.
- Safer concurrent request handling when serving multiple model workloads.
- More predictable chat prompt behavior in CLI/chat mode.
Compatibility
This is intended to be a patch-level fix. Public SimaLMM APIs are unchanged, and no migration is required for normal users.
Projects that consume SimaLMM::sima_lmm_runtime should continue using the installed CMake target. The target now avoids leaking build-specific include paths and should be easier to consume from clean environments.
Validation
The changes were reviewed through the SimaLMM package export and DevKit C++ request paths, then promoted through the release branches for v0.2.1.
Included changes
- Fix SimaLMM packaging exports and concurrent request queueing by @florianvoss-commit in #39
- Promote the SimaLMM packaging and queue fixes through
main,integration/0.2.1, andrelease-0.2in #41, #42, and #43
Full Changelog: v0.2.0...v0.2.1