Skip to content
This repository has been archived by the owner on Jun 1, 2024. It is now read-only.

ComfyUI InstantMesh is custom nodes that running InstantMesh into ComfyUI

License

Notifications You must be signed in to change notification settings

jtydhr88/ComfyUI-InstantMesh

Repository files navigation

(This repo is archived due to ComfyUI-3D-Pack supports InstantMesh, please check 3D-Pack directly if you need it)

ComfyUI InstantMesh

ComfyUI InstantMesh is custom nodes that running TencentARC/InstantMesh into ComfyUI

overall

Installation

Make sure you also install Visual Studio Build Tools. overall This extension depends on ComfyUI-3D-Pack, please install it if not, and make sure it works well:

  1. stop ComfyUI if it is running
  2. goto ComfyUI/custom_nodes dir in terminal(cmd)
  3. git clone https://github.com/MrForExample/ComfyUI-3D-Pack
  4. cd ComfyUI-3D-Pack
  5. run install_windows_portable_win_py311_cu121.bat

(Don't start ComfyUI at this moment)
Then, install this extension:

  1. git clone https://github.com/jtydhr88/ComfyUI-InstantMesh
  2. cd ComfyUI-InstantMesh
  3. run install_windows_portable_win_py311_cu121.bat

Start your ComfyUI.

How to use

Currently, this extension implements two custom nodes, InstantMeshLoader and InstantMeshRun

Regarding InstantMeshLoader, there are four configurations for checkpoints, please refer to TencentARC/InstantMesh for more details.

A simple workflow looks like: simple-connection And you can find it at simple-workflow
After generated, you could find results, mesh or texture, under ComfyUI/custom_nodes/ComfyUI-InstantMesh/output folder.

Another workflow I provided - example-workflow, generate 3D mesh from ComfyUI generated image, it requires:

  1. Main checkpoint - ReV Animated
  2. Lora - Clay Render Style

It will generate gypsum style 3D model: example-workflow1

Credit

  • TencentARC/InstantMesh - Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models
  • ComfyUI - A powerful and modular stable diffusion GUI.
  • ComfyUI-3D-Pack - An extensive node suite that enables ComfyUI to process 3D inputs (Mesh & UV Texture, etc) using cutting edge algorithms (3DGS, NeRF, etc.)

My extensions for ComfyUI

My extensions for stable diffusion webui

  • 3D Model/pose loader A custom extension for AUTOMATIC1111/stable-diffusion-webui that allows you to load your local 3D model/animation inside webui, or edit pose as well, then send screenshot to txt2img or img2img as your ControlNet's reference image.
  • Canvas Editor A custom extension for AUTOMATIC1111/stable-diffusion-webui that integrated a full capability canvas editor which you can use layer, text, image, elements and so on, then send to ControlNet, basing on Polotno.
  • StableStudio Adapter A custom extension for AUTOMATIC1111/stable-diffusion-webui to extend rest APIs to do some local operations, using in StableStudio.
  • Txt/Img to 3D Model A custom extension for sd-webui that allow you to generate 3D model from txt or image, basing on OpenAI Shap-E.
  • 3D Editor A custom extension for sd-webui that with 3D modeling features (add/edit basic elements, load your custom model, modify scene and so on), then send screenshot to txt2img or img2img as your ControlNet's reference image, basing on ThreeJS editor.

About

ComfyUI InstantMesh is custom nodes that running InstantMesh into ComfyUI

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published