Skip to content

v1.2.53 - Controlnet & Control Space

Choose a tag to compare

@imprsnst imprsnst released this 29 Jul 13:54
aa7a246

ControlNet support + Control Space

Four commits on top of main. Adds ControlNet to the local Core gen nodes, a new
3D editor to drive it, and generation recipes embedded in output images.

Control Space (new)

A full-screen 3D editor for posing OpenPose characters and framing a camera, then
rendering that as a control map. Multi-character, presets, orbit camera, output
aspect picker, pose or depth output.

Depth output builds a volumetric body: limb capsules with anatomical thickness, a
closed torso, and a skull with a face and nose along its forward axis, standing on
a ground plane against a backdrop. Facing reads straight off the pixels, and the
face hides behind the skull when a character turns away.

Pulls in three.js, @react-three/fiber and drei.

ControlNet

  • Z-Image: Control input port, controlnet picker and conditioning scale.
    Loads the Fun Union checkpoint offline via a bundled config.
  • Krea 2: depth control through the public Patil/Krea-2-depth-controlnet
    control-LoRA. Rank-64 on every block plus a wider input projection, so a
    VAE-encoded depth latent rides next to the noisy one.
  • Apply ControlNet node: turns any image into a pose, depth or canny map.

Control maps are now typed CONTROL so they can only feed a Control input. Wiring
one into img2img was silently running image-to-image from a black map, which looked
exactly like "ControlNet not working".

Other improvements

  • Drag drop generated image to load graph
  • Generated assets now carries entire generation info & settings.

What's Changed

  • Controlnet support: Control space & controlnet nodes by @imprsnst in #17

Full Changelog: v1.2.52...v1.2.53