[1.1.427] New preprocessor depth_hand_refiner

[fireantsmore]

Discussed in #2400

^{Originally posted by huchenlei January 4, 2024}
Thanks Fannovel16 for his hard work extracting dependencies out for hand refiner in https://github.com/Fannovel16/comfyui_controlnet_aux/.

Previously users need to use extensions like https://github.com/jexom/sd-webui-depth-lib to pick a matching hand gesture and move it to a correct location. depth_hand_refiner preprocess now does this job automatically for you.

How to use

Now you can manually draw the inpaint mask on hands and use a depth ControlNet unit to fix hands with following steps:

Step 1: Generate an image with bad hand.

Step 2: Switch to img2img inpaint. Draw inpaint mask on hands.

Step 3: Enable ControlNet unit and select depth_hand_refiner preprocessor.

Step 4: Generate

ADetailer usage example (Bing-su/adetailer#460):

You need to wait for ADetailer author to merge that PR or checkout the PR manually. This section is independent of previous img2img inpaint example. Here the generation is txt2img.

Image generated without ADetailer

Image generated with ADetailer

ADetailer setting

Make sure you adjust denoising strength so that depth map can take control of hand rendering.

Known issues

Hand refiner cannot handle complex hand gestures such as crossed fingers. Example: only 1 hand detected when finger are crossed:

[huchenlei]

Why copy/repost the discussion thread here?