Skip to content

mlx-bun v0.0.6

Choose a tag to compare

View all tags
@joshuarossi joshuarossi released this 24 Jun 01:57
v0.0.6
c9c3c90

mlx-bun v0.0.6

Highlights

  • mlx-bun train — ORPO/SFT/DPO LoRA fine-tuning from the CLI. Runs the full
    ORPO stack (flash-CCE head + prefix-sharing + segmented backward) on by default,
    auto-detects e4b/Gemma, streams loss, and saves a mountable adapter.
  • mlx-bun generate — a raw one-shot entry point with explicit sampling params.
  • --l1 / --l2 / --l3 tier aliases — one intent switch over the
    parity/performance route. --l1 = mlx-lm bf16 bit-for-bit, --l2 = mlx-optiq
    bit-for-bit (perf kernel on), --l3 = mlx-bun's fast originals.

Added

  • Web UI: sampling controls as sliders + floating popover; mixed-precision
    quantize with HF-cache output; ORPO web defaults.
  • Live train-watch dashboard + metrics stream with ORPO stability guards.
  • Control-flow DAG route map (flags, entry points, provenance) wired into the UI.

Fixed

  • --prompt-cache 0 now actually disables the prompt cache.
  • Tier default selects the fast kernel that holds the parity guarantee.
  • Training: fixed flash-CCE/attention host-buffer pin leak; dispose nested-op
    intermediates in the flash-CCE forward + loss head; de-dupe duplicate BOS when
    tokenizing templated DPO prompts.

Install: brew upgrade joshuarossi/tap/mlx-bun · npm i -g mlx-bun · bunx mlx-bun

Assets 4
Loading