Skip to content

fix: Diffusers and XPU fixes #5737

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 1, 2025
Merged

Conversation

richiejp
Copy link
Collaborator

@richiejp richiejp commented Jun 27, 2025

  • fix(README): Add device flags for Intel/XPU
  • fix(diffusers/xpu): Set device to XPU and ignore CUDA request when on Intel

Description

Diffusers appears to just run on CPU when using Intel devices. This sets the XPU env var the same as the transformers backend and ignors the model if it requests CUDA.

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Copy link

netlify bot commented Jun 27, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit d1a7a6a
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/68618cc49bfede0008fdda75
😎 Deploy Preview https://deploy-preview-5737--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@github-actions github-actions bot added the kind/documentation Improvements or additions to documentation label Jun 27, 2025
@richiejp richiejp marked this pull request as ready for review June 27, 2025 15:48
richiejp added 2 commits June 29, 2025 19:57
Signed-off-by: Richard Palethorpe <io@richiejp.com>
… Intel

Signed-off-by: Richard Palethorpe <io@richiejp.com>
@richiejp richiejp force-pushed the fix/xpu-diffusers branch from 2ace663 to d1a7a6a Compare June 29, 2025 18:58
@richiejp richiejp enabled auto-merge (rebase) June 29, 2025 18:58
@richiejp richiejp changed the title Diffusers and XPU fixes fix: Diffusers and XPU fixes Jul 1, 2025
@mudler mudler disabled auto-merge July 1, 2025 10:36
@mudler mudler merged commit b37cef3 into mudler:master Jul 1, 2025
26 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants