Skip to content

Show model loading failures to users - #108

Merged
Blaizzy merged 1 commit into
mainfrom
pc/model-load-failure-feedback
Jul 25, 2026
Merged

Show model loading failures to users#108
Blaizzy merged 1 commit into
mainfrom
pc/model-load-failure-feedback

Conversation

@Blaizzy

@Blaizzy Blaizzy commented Jul 25, 2026

Copy link
Copy Markdown
Owner

Summary

  • parse structured server error details for chat, image generation, and integrations
  • track model startup failures and show dismissible feedback in the Models page, control panel, menu, and session stats
  • label unsupported cached models and explain why they cannot be selected when clicked
  • add coverage for FastAPI error details, fallback HTTP messages, and startup-log extraction

Why

mlx-vlm now returns actionable HTTP 400 details when a model cannot be loaded (Blaizzy/mlx-vlm#1717), but Nativ did not consistently surface those details. Startup failures could leave the UI looking like it was still loading, and clicking a cached model with no supported preload role was a silent no-op.

User impact

Users now get the server's useful failure reason in the workflow where loading failed and in app-wide status surfaces. Unsupported models are visibly marked and explain that Nativ cannot use them for its supported serving roles.

Validation

  • xcodebuild -project Nativ.xcodeproj -scheme Nativ -destination 'platform=macOS,arch=arm64' CODE_SIGNING_ALLOWED=NO test — 92 tests passed
  • python3 -m py_compile PythonDistribution/Overlay/nativ_server.py PythonDistribution/Scripts/build_mlx_vlm_server.py
  • git diff --check

@Blaizzy
Blaizzy force-pushed the pc/model-load-failure-feedback branch from 4c36959 to 9211880 Compare July 25, 2026 19:32
@Blaizzy
Blaizzy marked this pull request as ready for review July 25, 2026 19:35

@Lazarus-931 Lazarus-931 left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@Blaizzy
Blaizzy merged commit 27bda7b into main Jul 25, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants