Skip to content

smthemex/ComfyUI_SenseNova_U1

Repository files navigation

ComfyUI_SenseNova_U1

SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-Unify Architecture

Update

  • 暂时以同步卸载模式适配moe模型,moe模式12G显存, 文生图时,count设置为8-9,图生图设置为4左右..
  • support SenseNova-U1-A3B-MoT-SFT and SenseNova-U1-A3B-MoT and SenseNova-U1-A3B-MoT-SFT-gguf ,支持A3B MOE的单体合并模型和gguf模型,快速测试可以修改节点加载repo的分割模型.
  • fix interleave some bugs ,add interleave max images number, 修复bug,交叉模式生成图片数量可以选入参,注意因为kv缓存的原因,越大越占用显存
  • support 8 steps lora now 支持 8步lora
  • Test it use 8G Vram 36G Ram ,确保内存(不是显存)大于36G
  • If Vram >16G make prefetch_count =0, 显存大于16G时,设置swap(prefetch_count)数值为0以关闭层交换(使用Q6 gguf时)

1.Installation

In the ./ComfyUI/custom_nodes directory, run the following:

git clone https://github.com/smthemex/ComfyUI_SenseNova_U1

2.requirements

pip install -r requirements.txt

3.checkpoints

8B-links
A3B-links
A3B-links-modelscope lora 夸克网盘

├── ComfyUI/models/gguf/
|     ├── SenseNova-U1-8B-MoT-8step-Q6_K.gguf # optional 可选
|     ├──SenseNova-U1-A3B-MoT-SFT-Q4_K_S.gguf # optional 可选
├── ComfyUI/models/diffusion_models/
|     ├── SenseNova-U1-8B-MoT-8step-merge_bf16.safetensors # optional 可选
|     ├── SenseNova-U1-A3B-MoT-SFT-merge_bf16.safetensors  可选
├── ComfyUI/models/loras/
|     ├── SenseNova-U1-8B-MoT-LoRA-8step-V1.0.safetensors # optional 可选

  1. Example

  • A3B MOE
  • 8B

Citation

About

enseNova-U1: Unifying Multimodal Understanding and Generation with NEO-Unify Architecture

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors