Skip to content

mlxtop v2.0.0

Choose a tag to compare

View all tags
@maximpri maximpri released this 02 Oct 23:57
· 27 commits to main since this release
v2.0.0
217ccc5
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

mlxtop 2.0.0

Stable major release for Apple Silicon macOS and Linux. This release expands runtime monitoring and makes the dashboard easier to interpret during real workloads.

What's new

  • Eleven runtimes: oMLX, Ollama, LM Studio/llmster, llama.cpp, KoboldCpp, MLX-LM, LocalAI, vLLM, SGLang, Jan and GPT4All. Available detail depends on each engine's API: live serving metrics, loaded-model information or model catalogues plus client-reported usage.
  • vLLM/SGLang Prometheus metrics, native Ollama/LM Studio inventories, authenticated HTTP/HTTPS endpoints, verified certificates and explicit opt-in for sending credentials to remote servers.
  • Synchronized rolling chart windows and zoom, clear window 34s labels, corrected queue crossings and more space for throughput and prompt history.
  • Cyan resident-memory history with separate pressure severity. Process-memory readings remain available in Top and text reports.
  • Native completion speeds, cached tokens and explicit first-token timings in the counters-only usage recorder. Completed reports are never presented as live generation rates.
  • Production line-coverage gates on macOS and Linux, updated documentation and a refreshed Overview screenshot.

Install or upgrade

curl -fsSL https://raw.githubusercontent.com/maximpri/mlxtop/main/scripts/install.sh | sh

Restart existing mlxtop sessions after upgrading. Existing configuration, oMLX settings and usage JSONL files remain compatible. The terminal installer selects the latest stable release and verifies its checksum; set MLXTOP_VERSION=2.0.0 to pin this release.

The dashboard monitors one selected endpoint per session. Engines without live performance APIs need client integration for completed-request statistics. Remote API monitoring does not collect the remote machine's OS counters; run mlxtop over SSH for those.

Downloads

  • Apple Silicon macOS: native DMG installer or tar.gz archive. Requires macOS 11 or later; tested locally on macOS 27.0.1. The installer is unsigned and not notarized.
  • Linux x86_64 and ARM64: static musl tar.gz archives without runtime library dependencies.
  • SHA256SUMS covers all four downloads. Packages include documentation, the usage recorder and dependency license texts.

Validation

  • macOS: 267 Rust tests passed; 13 Python tests passed.
  • Linux: 265 Rust tests passed on each architecture. ARM64 ran natively in Docker; x86_64 ran under emulation on Apple Silicon.
  • Formatting, Clippy, ShellCheck, dependency license checks, release builds and static-report smoke tests passed.
  • GitHub CI checks production coverage on macOS and Linux against a 90% minimum.
  • API fixtures cover provider schemas, authentication, counter resets, missing/stale values and usage-recorder timing. oMLX was also verified against a running Apple Silicon server. Other engines and NVIDIA telemetry use fixtures; physical NVIDIA hardware was not available.
  • The public latest-release installer was verified end-to-end on macOS, Linux ARM64 and Linux x86_64, including downloaded checksums and installed license notices.
  • One interactive preview test is intentionally ignored in automated suites. Optimized binaries, archive contents, the DMG installer payload and SHA-256 checksums were verified.

README · User guide · Changelog

Assets 7
Loading