Skip to content

Model CPU offload fix for BLIPDiffusion#5174

Merged
DN6 merged 1 commit intomainfrom
blip-cpu-offload
Sep 25, 2023
Merged

Model CPU offload fix for BLIPDiffusion#5174
DN6 merged 1 commit intomainfrom
blip-cpu-offload

Conversation

@DN6
Copy link
Copy Markdown
Collaborator

@DN6 DN6 commented Sep 25, 2023

What does this PR do?

Currently enable_model_cpu_offload does not work for BLIPDiffusion.

This PR:

  1. Adds the mode_cpu_offload_seq string to the BLIPDIffusionPipeline and BLIPDiffusionControlnetPipeline
  2. Makes some changes to the device used in the pipeline call to avoid device mismatch errors.

Fixes # (issue)

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

@DN6 DN6 changed the title Cpu offload fix for blip diffusion Cpu offload fix for BLIPDiffusion Sep 25, 2023
@DN6 DN6 changed the title Cpu offload fix for BLIPDiffusion Model CPU offload fix for BLIPDiffusion Sep 25, 2023
@DN6 DN6 requested a review from sayakpaul September 25, 2023 10:13
Copy link
Copy Markdown
Contributor

@patrickvonplaten patrickvonplaten left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks

Copy link
Copy Markdown
Member

@sayakpaul sayakpaul left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The sequence string specifier is really sick!

@DN6 DN6 merged commit 92f15f5 into main Sep 25, 2023
@kashif kashif deleted the blip-cpu-offload branch September 29, 2023 11:39
yoonseokjin pushed a commit to yoonseokjin/diffusers that referenced this pull request Dec 25, 2023
AmericanPresidentJimmyCarter pushed a commit to AmericanPresidentJimmyCarter/diffusers that referenced this pull request Apr 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants