Skip to content

MacBenchForge v2.1.0 - Native Mac App

Choose a tag to compare

@AdityaGuhaa AdityaGuhaa released this 09 Jul 08:38
· 11 commits to main since this release

Overview

MacBenchForge v2.1.0 introduces significant improvements to the local model discovery engine, hardens database persistence, and enhances the analytical visualization components of the dashboard.

Technical Improvements

Local Discovery & Validation

  • Optimized Directory Traversal: The local scanner has been refactored to specifically target standard macOS inference directories (~/Downloads, ~/.lmstudio, ~/.cache/lm-studio). This bypasses permission faults on protected root directories and significantly decreases scan latency.
  • Strict Model Filtering: Implemented validation checks during the scanning phase to filter out non-generative and auxiliary files.
    • Sub-100MB vocabulary files are now excluded from the index.
    • Vision-Language multi-modal projection weights (mmproj-*.gguf) are explicitly ignored, preventing execution failures within the llama-bench pipeline.

Database Persistence

  • State Reconciliation: The SQLite persistence layer has been updated with UPSERT logic. This ensures that dormant or temporarily unlinked models are correctly reactivated and reconciled during subsequent scans, preventing orphan records and ensuring accurate state representation in the UI.

Data Visualization

  • Granular Telemetry Render: The historical benchmark Bar Charts (Chart.js) have been updated with an inline data-label plugin. Exact Tokens-per-Second (t/s) metrics are now rendered directly atop their corresponding datasets, eliminating the need to cross-reference the Y-axis.

Installation

  1. Download MacBenchForge_v2.1.0_AppleSilicon.dmg from the assets below.
  2. Mount the volume and drag the MacBenchForge application into your Applications directory.
  3. Requirement: Ensure llama.cpp is installed via Homebrew (brew install llama.cpp) prior to executing benchmarks.