Skip to content

HCP-Diffusion V2

Choose a tag to compare

@IrisRainbowNeko IrisRainbowNeko released this 11 Apr 04:15
· 87 commits to neko since this release

HCP-Diffusion V2 is built on top of the 🐱 RainbowNeko Engine. Using python format config file instead of yaml, which can be more extensible, flexible, and user-friendly.

  • More user-friendly config file
  • Simplified configuration
  • More user-friendly model evaluation
  • More model and method support

✨ Features

πŸ“¦ Model Support

Model Name Status
Stable Diffusion 1.5 βœ… Supported
Stable Diffusion XL (SDXL) βœ… Supported
PixArt βœ… Supported
FLUX 🚧 In Development
Stable Diffusion 3 (SD3) 🚧 In Development

🧠 Fine-Tuning Capabilities

Feature Description/Support
LoRA Layer-wise Configuration βœ… Supported (including Conv2d)
Layer-wise Fine-Tuning βœ… Supported
Multi-token Prompt-Tuning βœ… Supported
Layer-wise Model Merging βœ… Supported
Custom Optimizers βœ… Supported (Lion, DAdaptation, pytorch-optimizer, etc.)
Custom LR Schedulers βœ… Supported

🧩 Extension Method Support

Method Status
ControlNet (including training) βœ… Supported
DreamArtist / DreamArtist++ βœ… Supported
Token Attention Adjustment βœ… Supported
Max Sentence Length Extension βœ… Supported
Textual Inversion (Custom Tokens) βœ… Supported
CLIP Skip βœ… Supported

πŸš€ Training Acceleration

Tool/Library Supported Modules
πŸ€— Accelerate βœ… Supported
Colossal-AI βœ… Supported
xFormers βœ… Supported (UNet and text encoder)

πŸ—‚ Dataset Support

Feature Description
Aspect Ratio Bucket (ARB) βœ… Auto-clustering supported
Multi-source / Multi-dataset βœ… Supported
LMDB βœ… Supported
webdataset 🚧 In Development
Local Attention Enhancement βœ… Supported
Tag Shuffling & Dropout βœ… Multiple tag editing strategies

πŸ“‰ Supported Loss Functions

Loss Type Description
Min-SNR βœ… Supported
SSIM βœ… Supported
GWLoss βœ… Supported

🌫 Supported Diffusion Strategies

Strategy Type Status
DDPM βœ… Supported
EDM βœ… Supported
Flow Matching βœ… Supported

🧠 Automatic Evaluation (Step Selection Assistant)

Feature Description/Status
Image Preview βœ… Supported (workflow preview)
FID 🚧 In Development
CLIP Score 🚧 In Development
CCIP Score 🚧 In Development
Corrupt Score 🚧 In Development