Skip to content

v1.2.62 - Minimax H3 Lora training still only

Choose a tag to compare

View all tags
@imprsnst imprsnst released this 05 Aug 15:24
v1.2.62
2cb6e04
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

Update: a 16GB card does work, from v1.2.63 onward. This release fell back to system
RAM for the text encoder but still handed it GPU tensors, so anything under about 24GB
failed with an index_select device mismatch.

MiniMax H3 LoRA training

image

You can now train a LoRA for MiniMax H3. It trains on still images, and the adapter applies to video.

  • Learns look, style, character and lighting
  • Does not learn motion or sound, because it never sees any
  • Works on all four H3 nodes, including Reference to Video
  • Pick MiniMax H3 in the Trainer's Adjust panel and point it at a folder of images

What it costs

Measured on an L40S, not projected.

Phase Peak VRAM
Encoding your images 10.8GB
Encoding your captions 20.5GB
Training 11.7GB
  • A run peaks at 20.6GB, and the caption pass sets it, not the training
  • So 512px and 768px cost the same
  • About 0.63s a step at 512px, plus roughly 7 minutes of startup
  • The 62GB checkpoint loads as 11.7GB, and host RAM stays near 1.1GB
  • On a card that holds the text encoder you need 24GB
  • 16GB cards: this release crashes. Fixed in v1.2.63, where a 16GB card trains H3 at a 12.7GB peak. See that release for the numbers
  • Auto model download support

Output Comparison(400 steps, purely testing purpose)

Context: trained a lora with a detailed skin dataset
Prompt: inline-skin-lora, detailed skin texture, A photoreal girl, 20 years old & facing camera

With LoRA vs Without LoRA

With LoRA Without LoRA
287d1fcb-6c20-4927-a237-529b626e9a3e.mp4
MiniMax.H3.Text.to.Video.mp4

Also in this release

  • Fixed two bugs in the existing trainer that affected Krea 2 and FLUX.2 4-bit runs
  • Every H3 node gained a LoRA input, so adapters from the Trainer load straight in

Video clip training, planned next

Today the H3 trainer takes still images only. Clips were planned and cut, and this is why:

  • schema migration
  • A new av>=12 dependency
  • The dataset grid accepting video, with thumbnails and a trim control
  • Audio rows

Links

Full Changelog: v1.2.61...v1.2.62

Contributors

imprsnst
Assets 2
Loading