Skip to content

support vllm served models

Pre-release
Pre-release

Choose a tag to compare

View all tags
@Mirix-AI Mirix-AI released this 23 Jul 08:22
· 348 commits to main since this release
v0.1.1
ac0a1f2

  1. vLLM Integration for Model Serving: MIRIX now supports serving models using vLLM. Developers can register their models through the UI by following the configuration template provided in configs/mirix_custom_model.yaml. For detailed instructions, refer to our documentation at https://docs.mirix.io/user-guide/custom-models/.

  2. Enhanced Chat Agent Behavior: The chat agent has been upgraded to allow direct updates to the memory system, even when screen monitoring is disabled.

Assets 3
Loading