Skip to content

Fix sample batch norms#18

Merged
sdbds merged 45 commits intosdbds:luminafrom
rockerBOO:fix-sample-batch-norms
Mar 2, 2025
Merged

Fix sample batch norms#18
sdbds merged 45 commits intosdbds:luminafrom
rockerBOO:fix-sample-batch-norms

Conversation

@rockerBOO
Copy link

@rockerBOO rockerBOO commented Feb 27, 2025

Based on #17

  • Fix sample reform norms when doing batches
  File "/mnt/900/builds/sd-scripts/library/lumina_train_util.py", line 687, in denoise
    if noise_norm >= max_new_norm:
RuntimeError: Boolean value of Tensor with more than one value is ambiguous

I can fix this PR by git cherry pick if it's confusing. I forgot to make it in a new branch from lumina.

kohya-ss and others added 30 commits January 27, 2025 20:50
(おそらく kohya-ss@be14c06 の修正漏れ )
…-recorder

Fix validation epoch loss to check epoch average
The postions_ids cause errors for the newer version of transformer.
This has already been fixed in convert_ldm_clip_checkpoint_v1() but
not in v2.
The new code applies the same fix to convert_ldm_clip_checkpoint_v2().
@sdbds sdbds merged commit d6c3e63 into sdbds:lumina Mar 2, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants