-
Notifications
You must be signed in to change notification settings - Fork 4.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Trajectory Consistency Distillation Support #2985
Comments
I have attempted this but need a little help finishing it! |
Workflow that works pretty fine for me (with SDXL-Lightning variant): |
I also tested this with my own base SDXL model merge. It worked fine! I just couldn't make it work with the DPMPP_3M_SDE Sampler, I'll keep exploring. Thank you so much! |
tcd is awesome! Hope it will be supported. |
I have this working pretty well with a modified Euler A sampler: https://github.com/dfl/comfyui-tcd-scheduler however AFAICT the reference diffusers implementation uses modified DDPM. I haven't yet figured out how to properly rescale the samples with that though. dfl/comfyui-tcd-scheduler#3 Also: In the diffusers implementation I get these values for 8 steps before they are modified by gamma: However in comfy the timesteps are slightly different... is this to be expected due to minor differences in implementation frameworks? |
someone asked about an img2img workflow... are there any extant nodes to extend this for img2img without rewriting the native KSampler? Also opened up the question of how TCD might ever be natively integrated. Given my current understanding of the ComyfUI architecture, I don't see how sending additional KSampler parameters like TCD's gamma/eta could be possible... @comfyanonymous what are your thoughts/advice on this please? dfl/comfyui-tcd-scheduler#4 (comment) I think the general notion of blending between stochastic and deterministic is pretty cool, and could be useful even without the TCD LoRA, just with more typical/traditional sampling steps. |
New Hyper-SD (Trajectory Segmented Consistency Distillation) from bytedance apparently runs atop of diffusers's TCDScheduler aswell. |
Yes we adopt the TCDScheduler on our unified LoRAs. |
Not a dev so i will tag comfy instead @comfyanonymous, sir comfy please do the needful sirs |
@comfyanonymous |
Native KSampler does not support extra parameters like TCD’s Gamma. |
I've implemented another tcd comfyui node. repo: https://github.com/JettHu/ComfyUI-TCD |
@YanzuoLu I am preparing to submit a PR for comfyui to add tcd to the comfyui official scheduler. |
@JettHu |
Trajectory Consistency Distillation needs a confyui native TCDScheduler
https://github.com/jabir-zheng/TCD
https://huggingface.co/h1t/TCD-SDXL-LoRA
The text was updated successfully, but these errors were encountered: