Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I need a tutorial.I need help #8

Open
salier opened this issue Feb 3, 2024 · 14 comments
Open

I need a tutorial.I need help #8

salier opened this issue Feb 3, 2024 · 14 comments

Comments

@salier
Copy link

salier commented Feb 3, 2024

Hi, your tutorial is a bit too brief. I want to know if you need to overwrite it with a project file or just copy the workflow and model. I referred to your installation process and it failed. I am using the already installed comfyui, but I don't know how to import the workflow, and I haven't seen any new nodes. I need your help

@MrForExample
Copy link
Owner

Hi friend, no problem, I'll add some description to each examples 👍
I also updated the examples yesterday, feel free to give a try

@salier
Copy link
Author

salier commented Feb 5, 2024

Thank you very much. I have successfully run the legend. However, it seems that the model is based on a 256*256 resolution, and the effect is not ideal after changing the resolution. I noticed that many solutions are to create a new model from scratch, so I was wondering if it is possible to modify or refine the existing model by baking displacement and normal maps with Gaussian splash. Specifically, we generate textures, normals and displacement maps from fixed images and bake them to UV. Then we choose to re-bake low-mode or box-selection subdivision to achieve higher detail depending on the purpose. At present, I have achieved the verification stage in Blender (although the process is relatively complex).

@salier
Copy link
Author

salier commented Feb 5, 2024

And, I probably don't know how to use it. It's not difficult to simply install dependencies. I haven't seen how to start it, so I may need some features on how to load "Preview 3DGS and 3D Mesh", "Gaussian Splitting Orbit Renderer", "Deep Marching Tetrahedrons", and "Switch Axis for 3DGS&3D Mesh". The functions are listed, but there is no relevant information.

@MrForExample
Copy link
Owner

MrForExample commented Feb 5, 2024

I was wondering if it is possible to modify or refine the existing model by baking displacement and normal maps with Gaussian splash ..... we generate textures, normals and displacement maps from fixed images and bake them to UV

Baking displacement and normal maps from Gaussian Splatting? Well, I haven't done my research on this yet, but from what I know, there is no easy to do so just yet, but I think you could try using currently available method to convert albedo texture into normal and displacement maps.
And, it is possible to bake high-resolution images onto existing mesh using Bake Multi-View images into UVTexture node, but currently this node only support single UV and single albedo texture for entire mesh. I'll extend it to FBX format and multiple UV & different types of textures in the future, currently I'm focus on ability for this tool to generate good enough initial result.

Document will be updated along with each feature update, cheers friend 👍

@salier
Copy link
Author

salier commented Feb 5, 2024

Thank you very much. I use traditional methods such as Marigold depth recognition, which involves recalibrating the depth ruler to uniformly calibrate the depths on both images, and then performing baking replacement.Hope to see more solutions and better results, good luck

@m-ali-awan
Copy link

Hi @salier @MrForExample

C:\Users\Owner\Downloads\StabilityMatrix-win-x64\Data\Packages\ComfyUI>"venv\Scripts\python.exe" -m pip install custom_nodes\ComfyUI-3D-Pack\diff-gaussian-rasterization
Processing c:\users\owner\downloads\stabilitymatrix-win-x64\data\packages\comfyui\custom_nodes\comfyui-3d-pack\diff-gaussian-rasterization
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: diff_gaussian_rasterization
  Building wheel for diff_gaussian_rasterization (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [9 lines of output]
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build\lib.win32-cpython-310
      creating build\lib.win32-cpython-310\diff_gaussian_rasterization
      copying diff_gaussian_rasterization\__init__.py -> build\lib.win32-cpython-310\diff_gaussian_rasterization
      running build_ext
      error: [WinError 2] The system cannot find the file specified
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for diff_gaussian_rasterization
  Running setup.py clean for diff_gaussian_rasterization
Failed to build diff_gaussian_rasterization
ERROR: Could not build wheels for diff_gaussian_rasterization, which is required to install pyproject.toml-based projects

I am not able to install this library, and have tried everything. Also I thought, maybe it is having problem with c++ build tools, so have tried adding cuda, cl to path etc

But still this error holds.

Kindly help me on this, if you are able to navigate through it..

Thanks

@0X-JonMichaelGalindo
Copy link

Hi @m-ali-awan I recommend using Miniconda, following the instructions in the readme. venv is bad at resolving version conflicts. Only Miniconda has worked for me.

@m-ali-awan
Copy link

Thanks @0X-JonMichaelGalindo ,
I have used miniconda as well, but this issue persists

@m-ali-awan
Copy link

Can you kindly share me your library versions, and system specs..
eg, CUDA version, windows version etc..

@MrForExample
Copy link
Owner

Very likely there is something to do with building tools.
I would try, update the C++ building tools in Visual Studio, I'm using VS2022.
And when using miniconda, try to use it's terminal, and activate the environment first before running install.

@grimbit
Copy link

grimbit commented Feb 16, 2024

I have VS2022 and was getting same issues.

Successfully built nvdiffrast kiui Failed to build pointnet2_ops simple_knn diff_gaussian_rasterization pytorch3d torch_scatter ERROR: Could not build wheels for pointnet2_ops, simple_knn, diff_gaussian_rasterization, pytorch3d, torch_scatter, which is required to install pyproject.toml-based projects

Some things build, while others don't.

@nikolaiusa
Copy link

Hi @salier @MrForExample

C:\Users\Owner\Downloads\StabilityMatrix-win-x64\Data\Packages\ComfyUI>"venv\Scripts\python.exe" -m pip install custom_nodes\ComfyUI-3D-Pack\diff-gaussian-rasterization
Processing c:\users\owner\downloads\stabilitymatrix-win-x64\data\packages\comfyui\custom_nodes\comfyui-3d-pack\diff-gaussian-rasterization
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: diff_gaussian_rasterization
  Building wheel for diff_gaussian_rasterization (setup.py) ... error
  error: subprocess-exited-with-error

  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [9 lines of output]
      running bdist_wheel
      running build
      running build_py
      creating build
      creating build\lib.win32-cpython-310
      creating build\lib.win32-cpython-310\diff_gaussian_rasterization
      copying diff_gaussian_rasterization\__init__.py -> build\lib.win32-cpython-310\diff_gaussian_rasterization
      running build_ext
      error: [WinError 2] The system cannot find the file specified
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for diff_gaussian_rasterization
  Running setup.py clean for diff_gaussian_rasterization
Failed to build diff_gaussian_rasterization
ERROR: Could not build wheels for diff_gaussian_rasterization, which is required to install pyproject.toml-based projects

I am not able to install this library, and have tried everything. Also I thought, maybe it is having problem with c++ build tools, so have tried adding cuda, cl to path etc

But still this error holds.

Kindly help me on this, if you are able to navigate through it..

Thanks

do you can to fix the error? I have the same problem

@mothormothormothor
Copy link

I have VS2022 and was getting same issues.

Successfully built nvdiffrast kiui Failed to build pointnet2_ops simple_knn diff_gaussian_rasterization pytorch3d torch_scatter ERROR: Could not build wheels for pointnet2_ops, simple_knn, diff_gaussian_rasterization, pytorch3d, torch_scatter, which is required to install pyproject.toml-based projects

Some things build, while others don't.

Hey there, have you managed to find a solution for this error? I have the same problem.
Cheers

@grimbit
Copy link

grimbit commented Mar 2, 2024

I have VS2022 and was getting same issues.
Successfully built nvdiffrast kiui Failed to build pointnet2_ops simple_knn diff_gaussian_rasterization pytorch3d torch_scatter ERROR: Could not build wheels for pointnet2_ops, simple_knn, diff_gaussian_rasterization, pytorch3d, torch_scatter, which is required to install pyproject.toml-based projects
Some things build, while others don't.

Hey there, have you managed to find a solution for this error? I have the same problem. Cheers

Nope. Haven't had time to check.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

7 participants