-
Notifications
You must be signed in to change notification settings - Fork 6.5k
Support unittest for Z-image ⚡️ #12715
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…, Remove once func in pipeline.
…ryWu-code/z-image # Conflicts: # src/diffusers/models/transformers/transformer_z_image.py
…peat; Add hint for attn processor.
…ace its origin implement; Add DocString in pipeline for that.
…rd, replace its origin implement; Add DocString in pipeline for that." This reverts commit fbf26b7.
…al commit for fa3 compatibility.
… pre-encode as List of torch Tensor.
…tibility with unitest in model, mostly precision formating.
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
yiyixuxu
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks so much for the PR! I left some small suggestions:)
let me know what you think
|
Hi yiyi, this commit e277137 is ready to merged !! 🚀🚀🚀 Thanks 😊 |
yiyixuxu
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks! will merge as soon as CI passes
| # Cannot use enable_full_determinism() which sets it to True | ||
| os.environ["CUDA_LAUNCH_BLOCKING"] = "1" | ||
| os.environ["CUBLAS_WORKSPACE_CONFIG"] = ":16:8" | ||
| torch.use_deterministic_algorithms(False) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I merged this but the tests are a bit flaky (it passed now and passed on my local but I think it is a bit non-deterministic)
Just making a note if it comes up in the future and we can look into it @sayakpaul @DN6
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah, that would be great !!! Looing forward to that version hah, Thanks your team ~ 😊
What does this PR do?
This PR adds unittest for Z-image Series⚡️ as discussed in #12703 (comment). Z-Image-Turbo, the distillation variant of our Z-Image, could generate 1K resolution photorealistic photo while excels in complex en/zh text rendering within 1-second in H800/H100 cards in bf16-precision.
Z-Image is a powerful and highly efficient 6B-parameter image generation model that is friendly for consumer-grade hardware, with strong capabilities in photorealistic image generation, accurate rendering of both complex Chinese and English text, and robust adherence to bilingual instructions.
The technical report and Z-Image-Turbo checkpoint will be released very soon !!!
Thanks for the support of @yiyixuxu.
Fixes # (issue)