My Colab version of exciting new nvdiffrec from Nvidia
https://github.com/NVlabs/nvdiffrec
What is new is that it is now able to extract and remove environment lighting from texture. so env lighting is no longer baked in texture, and objects can finally be animated moved under your own lighting. Something that was holding nerf textured mesh outputs back in the past.
As for any questions regarding how to do this or that you will be best served in issues section of authors. I created this just jesterday and was able to run just run included demo dataset yet.
As for how to create custom dataset for to reonstruct from your own images. My guess asking in issues section in authors github will be much faster and better answer. but for now i guess. following https://github.com/sxyu/svox2 how to do custom nerf dataset using colmap could work too. I will try this today and update repo with what I found.
Sadly this algo requires you to provide masks in alpha of images (like it is done in synthetic nerf datasets) as this mask detection is not part of this algo pipeline yet.
Update:
Important Info/script/guide? regarding how to produce required alpha masks for your images? NVlabs/nvdiffrec#3
just look at that texture purity ;D yay
