Question for Reproducing Result

[EadCat]

Hi, I reproduced ICON and trained with THuman2.0.

As a result of the my training, only this model produces a lot of noise and isolated mesh.

Would you give me an advice?

I used [-1, 1] SMPL vertices, query points, and 15.0 SDF clipping.

I believe that ICON has great potential and generalization performance.

But I don't know what is the problem.

The results below are about unseen data, and I used pre-trained GCMR just like PaMIR for SMPL prediction.

Thank you.

[EadCat]

This is my query code of ICON.

[YuliangXiu]

smpl_cmap and smpl_norm are not necessary for the reconstruction, you could remove them one by one, retrain and check the results. Also, the SDF--> TSDF operation could also be removed.

[EadCat]

Are smpl_vis and feat_select necessary?
They are seem to optional in your code.

[YuliangXiu]

I am afraid not.

Given only the smpl_sdf, it's almost impossible for the network to figure out which normal should be used. Maybe smpl_norm should be included in such case.

[EadCat]

I only removed TSDF operation and got better results.

Many thanks!

[YuliangXiu]

@EadCat These noisy artifacts could be reduced with current normal refinement module in ICON, set -loop_cloth 50.

[EadCat]

Sure. I will implement pre-/post-optimizations.
Thank you for the helps.