5) Dynamic and generative Nerfs (Text to nerf)

• Deformable/Animation
  • D-nerf
  • K-Planes: Explicit Radiance Fields in Space, Time, and Appearance
  • NeuS2
• Text to nerf
  • Dreamfusion, 2022
  • NVIDIA magic 3d, 2022
  • Beyond RGB: Scene-Property Synthesis with Neural Radiance Fields
  • NeRF-Art: Text-Driven Neural Radiance Fields Stylization, 2022
  • Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions, 2023
  • NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models, 2023
  • DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model
  • Service

Table of contents generated with markdown-toc

Deformable/Animation

• https://github.com/hustvl/TiNeuVox

D-nerf

https://github.com/albertpumarola/D-NeRF

K-Planes: Explicit Radiance Fields in Space, Time, and Appearance

https://sarafridov.github.io/K-Planes/

NeuS2

https://vcai.mpi-inf.mpg.de/projects/NeuS2/

Text to nerf

Nerfs are per se generative but here are papers that generate scenes from text prompts.

Dreamfusion, 2022

https://dreamfusion3d.github.io/ Implementation https://github.com/nerfstudio-project/nerfstudio/pull/1008/files

NVIDIA magic 3d, 2022

• https://deepimagination.cc/Magic3D/

Beyond RGB: Scene-Property Synthesis with Neural Radiance Fields

• https://arxiv.org/pdf/2206.04669.pdf

NeRF-Art: Text-Driven Neural Radiance Fields Stylization, 2022

• https://cassiepython.github.io/nerfart/

Instruct-NeRF2NeRF: Editing 3D Scenes with Instructions, 2023

• https://instruct-nerf2nerf.github.io/
• https://instruct-nerf2nerf.github.io/data/videos/body_transform.mp4 Now part of Nerdfstudio 2.0

NeuralField-LDM: Scene Generation with Hierarchical Latent Diffusion Models, 2023

https://research.nvidia.com/labs/toronto-ai/NFLDM/?=&linkId=100000199325886

DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model

• https://janeyeon.github.io/ditto-nerf/

Service

https://captures.lumalabs.ai/imagine