Skip to content

Fixes for --flux_fast_schedule - #803

Merged
bghira merged 1 commit into
bghira:mainfrom
mhirki:fix-flux_fast_schedule
Aug 18, 2024
Merged

Fixes for --flux_fast_schedule#803
bghira merged 1 commit into
bghira:mainfrom
mhirki:fix-flux_fast_schedule

Conversation

@mhirki

@mhirki mhirki commented Aug 18, 2024

Copy link
Copy Markdown
Contributor

This fixes issue #780. I tested it with a batch size of 2. I'm also fixing the schedule to what I believe is correct based on SD3-Turbo paper. Schnell training is still broken based on a quick 500 step test run. So the advice is still to stay away from Schnell.

…and simplify the code. Also fixing the sigma schedule to what should be correct based on SD3-Turbo paper.
@bghira

bghira commented Aug 18, 2024

Copy link
Copy Markdown
Owner

would you be interested in attempting to port the assistant lora code from ostris' ai-toolkit?

@bghira
bghira merged commit 5bd7360 into bghira:main Aug 18, 2024
@mhirki

mhirki commented Aug 18, 2024

Copy link
Copy Markdown
Contributor Author

Not really interested and I don't have enough spare time either.

@bghira

bghira commented Aug 18, 2024

Copy link
Copy Markdown
Owner

same :D

samzhang996-hue pushed a commit to samzhang996-hue/SimpleTuner that referenced this pull request Apr 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants