v0.2.3 changes

[bghira]

Aspect bucketing changes

• More robust handling of seen_images, improving on v0.2.2 changes.
• More efficient bucket changing mechanism. No longer considers exhausted buckets.
• Fix for running out of images early and looping forever.
• Running out of images in a single bucket is downgraded from a WARNING log to DEBUG, as this is a normal operating condition.
• Once ALL buckets are exhausted, we will log the training state, and bump current_epoch by one.
• Fixed logging message so that remaining image count is correctly updated to reflect that it is the total image count

Optimizers

• Added --use_adafactor_optimizer without the configurable flags to make it a drop-in for AdamW8Bit. Use with caution, as it is not tested. However, it could help with consumer GPU training support (24G).

Prompt library

• Adjusted some prompts, removed prompt weighting
• User prompt library can now be created and used in addition to, or in place of the SimpleTuner prompt library. See the option --user_prompt_library help and the user_prompt_library.json.example document for more information.
• New prompts added to SimpleTuner library:
  • portrait photography of a beautiful Japanese young geisha with make-up looking at the camera, intimate portrait composition, high detail, a hyper-realistic close-up portrait, symmetrical portrait, in-focus, portrait photography, hard edge lighting photography, essay, portrait photo man, photorealism, serious eyes, leica 50mm, DSLRs, f1. 8, artgerm, dramatic, moody lighting, post-processing highly detailed
    • seems to be a really strong concept in SDXL. if it breaks, you are in danger.
  • The Great Wave off Kanagawa
  • a stunning portrait of a soviet television news show in a 1977 wes anderson style 70mm film shoot

General changes

• Better logging, with less noise
• Trainer statistics are now printed on every epoch refresh, when SIMPLETUNER_LOG_LEVEL=INFO or higher
• Renamed seen_state.json to seen_images.json
• Added --tracker_project_name and adjusted default value of --tracker_run_name
• Adjusted value of --learning_rate_end for Polynomial scheduler to 4e-7 from 1e-7
• Refactored data loaders and bucket samplers to be more robust and maintainable
• Training state is now saved as a part of the checkpoint itself. Upon resume, the training state is resumed from the checkpoint. This is a breaking change.
• Fix save path for final checkpoint.