Skip to content

Conversation

@mudler
Copy link
Owner

@mudler mudler commented Nov 11, 2025

Description

This PR is a starting point for #7114

It adds an import section by URL:

Screenshot 2025-11-11 at 22-33-21 LocalAI - Import Model
senza.titolo.mp4

Currently covers:

  • full URL files to gguf (llama-cpp), limited to single files-model (for now)
  • MLX

Example specify https://huggingface.co/Qwen/Qwen3-0.6B-GGUF/blob/main/Qwen3-0.6B-Q8_0.gguf will automatically install and configure the model with llama.cpp.

It currently abstracts away to "Importers" and prepares scaffolding (moves the HF api client) to pkg as we would need to use it to parse the repository if one is provided

Todo:

  • Add support for selection of GGUF file if adding the whole repository
  • Add support for multiple files with llama.cpp (models split in different gguf files)
  • Add support for GGUF with mmproj files (VL models)
  • Add support for models in subfolders
  • Add support for other providers (vLLM, etc)
  • Support OCI/ollama

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

@netlify
Copy link

netlify bot commented Nov 11, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit 9366052
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/6914d0f79973f40008445c7e
😎 Deploy Preview https://deploy-preview-7245--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@mudler mudler changed the title WIP WIP feat: import models via URI Nov 11, 2025
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler changed the title WIP feat: import models via URI feat: import models via URI Nov 11, 2025
@mudler mudler marked this pull request as ready for review November 11, 2025 21:35
@mudler mudler added enhancement New feature or request and removed dependencies labels Nov 11, 2025
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler force-pushed the feat/import-url branch 2 times, most recently from 8948e37 to dd07535 Compare November 12, 2025 11:54
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler merged commit 3728552 into master Nov 12, 2025
40 checks passed
@mudler mudler deleted the feat/import-url branch November 12, 2025 19:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dependencies enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants