Skip to content

AeroLLM 0.1.0

Latest
Latest

Choose a tag to compare

View all tags
@mahiatlinux mahiatlinux released this 15 Jun 06:46
· 1 commit to main since this release
v0.1.0
298cd1c

AeroLLM 0.1.0

A local LLM chat app for Apple Silicon Macs. It browses and downloads models from Hugging Face, runs them on-device with MLX, and can expose an OpenAI-compatible API for other apps.

Edit: Bug fixes

  • Fixed short prompts for thinking models in the bundled MLX runtime.
  • Thinking models without an enable_thinking switch now show Thinking as locked on.
  • Locked Thinking pill shows Doesn't support toggling instantly.

Requirements

  • Apple Silicon (arm64) Mac. Intel is not supported.
  • macOS 14 (Sonoma) or later.
  • Disk space for the models you download. Each is several GB.

Install

  1. Open AeroLLM-0.1.0-arm64.dmg and drag AeroLLM to Applications.
  2. This build is ad-hoc signed. It is not Apple Developer ID signed or notarized because this project does not have a paid Apple Developer account. On first launch macOS Gatekeeper blocks it. To open it, either right-click the app and choose Open, then Open in the dialog, or run this once in Terminal:
xattr -dr com.apple.quarantine /Applications/AeroLLM.app

After that it opens normally.

Network use

  • Inference runs locally.
  • Network use is Hugging Face for model search and downloads, plus the optional speech feature, which downloads its runtime when you install it.

Checksum

SHA-256: 4c5ff4d23d95c77edeeb940b28f368eadee57b5d70e3e08b7b84484f02f414ff
Assets 3
Loading