MacBenchForge v2.1.1 - Gatekeeper Hotfix

Hotfix Overview

This is a small patch release that addresses a macOS Gatekeeper issue where downloading the .dmg via a web browser would cause macOS to incorrectly flag the app bundle as "damaged" due to quarantine attributes.

🐛 Bug Fixes

• Gatekeeper Signing: The DMG packaging pipeline has been updated to automatically strip extended attributes and apply an ad-hoc cryptographic signature to the app bundle before distribution.

📦 Installation

1. Download MacBenchForge_v2.1.1_AppleSilicon.dmg below.
2. Mount the volume and drag MacBenchForge to your Applications directory.
3. Requirement: Ensure llama.cpp is installed via Homebrew (brew install llama.cpp) prior to executing benchmarks.

Note for macOS Users:
Because this tool is open-source and relies on an ad-hoc signature, macOS might warn you that it's from an "unidentified developer" when you first open it.
To bypass this, open your Applications folder, Right-Click (or Control-Click) on MacBenchForge.app, and select Open. You only need to do this once!

Alternatively, you can clear the quarantine flag via terminal:
xattr -cr /Applications/MacBenchForge.app

MacBenchForge v2.1.0 - Native Mac App

Overview

MacBenchForge v2.1.0 introduces significant improvements to the local model discovery engine, hardens database persistence, and enhances the analytical visualization components of the dashboard.

Technical Improvements

Local Discovery & Validation

• Optimized Directory Traversal: The local scanner has been refactored to specifically target standard macOS inference directories (~/Downloads, ~/.lmstudio, ~/.cache/lm-studio). This bypasses permission faults on protected root directories and significantly decreases scan latency.
• Strict Model Filtering: Implemented validation checks during the scanning phase to filter out non-generative and auxiliary files.
  • Sub-100MB vocabulary files are now excluded from the index.
  • Vision-Language multi-modal projection weights (mmproj-*.gguf) are explicitly ignored, preventing execution failures within the llama-bench pipeline.

Database Persistence

• State Reconciliation: The SQLite persistence layer has been updated with UPSERT logic. This ensures that dormant or temporarily unlinked models are correctly reactivated and reconciled during subsequent scans, preventing orphan records and ensuring accurate state representation in the UI.

Data Visualization

• Granular Telemetry Render: The historical benchmark Bar Charts (Chart.js) have been updated with an inline data-label plugin. Exact Tokens-per-Second (t/s) metrics are now rendered directly atop their corresponding datasets, eliminating the need to cross-reference the Y-axis.

Installation

1. Download MacBenchForge_v2.1.0_AppleSilicon.dmg from the assets below.
2. Mount the volume and drag the MacBenchForge application into your Applications directory.
3. Requirement: Ensure llama.cpp is installed via Homebrew (brew install llama.cpp) prior to executing benchmarks.

MacBenchForge v1.2.1 - The Apple Silicon Update

Welcome to MacBenchForge v1.2.1! This release focuses on stability, accurate hardware detection, and an improved out-of-the-box experience for Apple Silicon Macs.

🚀 What's New

• Native App Bundle Fixes: Completely resolved an issue where launching the packaged .app bundle or DMG would result in a HTTP ERROR 404. The local server now correctly resolves its internal frontend directory regardless of where it is launched on your Mac.
• Intelligent Ghost Process Management: Fixed bugs related to overlapping background processes that could cause port conflicts.
• Advanced VRAM Detection: The hardware UI no longer guesses your VRAM capacity. It now directly queries the macOS kernel (sysctl iogpu.wired_limit_mb) to dynamically detect the exact Metal-wired limit of your Unified Memory. If you are a power user who has manually overridden your Mac's IOGPU memory limits via terminal, the UI will now accurately reflect your custom VRAM headroom in real-time!
• Comprehensive Audit Fixes: Fixed duplicate background benchmark runs, improved SQLite database thread-safety, bound the local server to 127.0.0.1 for better security, and patched UI rendering issues on radar charts.

🛠️ Installation

1. Download the MacBenchForge_v1.2.1_AppleSilicon.dmg below.
2. Open the DMG and drag MacBenchForge.app into your Applications folder.
3. Launch the app to automatically open your local dashboard!

Note: If you receive a macOS Gatekeeper warning, you can safely bypass it by right-clicking the app and selecting "Open", or by running xattr -cr /Applications/MacBenchForge.app in your terminal.

MacBenchForge v1.1.0 - The Apple Silicon Update

Welcome to MacBenchForge v1.1.0! This release focuses on stability, accurate hardware detection, and an improved out-of-the-box experience for Apple Silicon Macs.

🚀 What's New

• Native App Bundle Fixes: Completely resolved an issue where launching the packaged .app bundle or DMG would result in a HTTP ERROR 404. The local server now correctly resolves its internal frontend directory regardless of where it is launched on your Mac.
• Intelligent Ghost Process Management: Fixed bugs related to overlapping background processes that could cause port conflicts.
• Advanced VRAM Detection: The hardware UI no longer guesses your VRAM capacity. It now directly queries the macOS kernel (sysctl iogpu.wired_limit_mb) to dynamically detect the exact Metal-wired limit of your Unified Memory. If you are a power user who has manually overridden your Mac's IOGPU memory limits via terminal, the UI will now accurately reflect your custom VRAM headroom in real-time!

🛠️ Installation

1. Download the MacBenchForge_v1.1.0_AppleSilicon.dmg below.
2. Open the DMG and drag MacBenchForge.app into your Applications folder.
3. Launch the app to automatically open your local dashboard!

Note: If you receive a macOS Gatekeeper warning, you can safely bypass it by right-clicking the app and selecting "Open", or by running xattr -cr /Applications/MacBenchForge.app in your terminal.

MacBenchForge v0.1.0 (Apple Silicon)

MacBenchForge v0.1.0 🚀

Welcome to the very first release of MacBenchForge, a native Apple Silicon hardware benchmarking tool for Large Language Models (LLMs)!

Highlights in this release:

• Native macOS App Bundle fully packaged with a beautiful custom ADI logo.
• Apple Silicon Optimized: Native integration with llama-bench and Meta's Llama 3 models via Homebrew.
• Web Dashboard: A stunning, dark-mode glassmorphism UI for running benchmarks and viewing real-time hardware metrics (CPU/GPU/RAM).
• Automated Environment: Smart fallback paths, config loaders, and automated C++ SQLite database integrations for tracking run history.
• One-Click Installs: Download the .dmg, drag to Applications, and you're benchmarking!

Installation

1. Download MacBenchForge_v0.1.0_AppleSilicon.dmg below.
2. Double click to mount it.
3. Drag MacBenchForge to your Applications folder and launch!