Skip to content

dsh-llm-mlx v0.2.2

Choose a tag to compare

@robbywang25 robbywang25 released this 30 Aug 22:47

Adds an optional MLX-VLM maxNumSeqs setting so memory-constrained Macs can serialize concurrent agent requests with --max-num-seqs. The setting is rejected for MLX-LM; existing defaults remain unchanged. Includes the macOS Desktop PTY compatibility fix from v0.2.1.