Skip to content

Hands on: Representing plants as Nerf

lightfield botanist edited this page Jun 11, 2023 · 6 revisions

Table of contents generated with markdown-toc

Public data sets

Datasets for agriculture/forestry (mostly photo-based for ag.):

Nerfs from flowers

  • Good fit for frequency based encoding
  • Easy to capture from ground

See also my macro photo test

Tree and drones

Tree capture challenges

  • Wind moves leaves, so they look blurry
  • Dense leaves hide branches, leaves tend to look blurry image
  • Shadows, High contrast, not easy to shot drone HDR
Resolution limitations, nerf dont enlarge things

Lower and mid-low cameras

Tests

Synthetic Nerf data in NVIDIA instant nerf (from https://drive.google.com/drive/folders/1JDdLGDruGNXWnM1eqY1FNL9PlStjaKWi)

Render and mesh (inflation parameters dont work well for leaves)

Drone flight free standing leavy tree, Orbits in 4 heights

DJI Footage (4 flights, ca 50s each, 25 fps, ca 2K resolution). 4GB memory

image 2 layers, 11 GB memory

Codec:

Cutting planes

First test (Realtime rendering instant Nerf, fps 6, from 300 images, aabb 16): Details are blurry

Mesh

max 700 voxels on this machine

Footage: High Orbit

Mid

Low