Skip to content

fix(mlx-vlm): install torch dependencies on Metal - #11164

Merged
mudler merged 1 commit into
masterfrom
bot/issue-9810-mlx-vlm-torch
Jul 28, 2026
Merged

fix(mlx-vlm): install torch dependencies on Metal#11164
mudler merged 1 commit into
masterfrom
bot/issue-9810-mlx-vlm-torch

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

What

Add torch and torchvision to the MLX-VLM Metal requirements. Some Transformers processors used by Qwen vision models import both libraries, but the pinned MLX-VLM base dependencies do not install them, causing model loading to fail.

Fixes #9810.

Testing

  • Confirmed the manifest assertion fails on master because torch is absent.
  • Confirmed the updated manifest contains the pinned MLX-VLM dependency plus valid torch and torchvision entries.
  • Ran git diff --check.

A full Metal backend build was not run because this cron host is Linux.

Documentation

Not required: this corrects packaged runtime dependencies without changing configuration or user-facing APIs.

Some Transformers processors used by MLX-VLM, including Qwen vision models, import both PyTorch and Torchvision. Include them in the Metal backend environment so model loading does not fail with missing-library errors.

Assisted-by: Codex:gpt-5
@localai-org-maint-bot
localai-org-maint-bot force-pushed the bot/issue-9810-mlx-vlm-torch branch from 480e28f to 01bf123 Compare July 28, 2026 16:05
@mudler
mudler merged commit 996bdce into master Jul 28, 2026
70 checks passed
@mudler
mudler deleted the bot/issue-9810-mlx-vlm-torch branch July 28, 2026 17:45
@localai-bot localai-bot added the bug Something isn't working label Aug 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

mlx-vlm requires pytorch and torchvision but doesn't install it, can't figure out how to get it to install

3 participants