PCL(Point Cloud) export

[nooskuyh]

I want to export the point cloud shown in the testbed.
so i have tried this code,

import argparse
import os
import commentjson as json

import numpy as np

import sys
import time

from common import *
from scenes import scenes_nerf, scenes_image, scenes_sdf, scenes_volume, setup_colored_sdf

from tqdm import tqdm

import pyngp as ngp # noqa
from plyfile import PlyData, PlyElement
from scenes import scenes_nerf, scenes_image, scenes_sdf, scenes_volume, setup_colored_sdf

mode = ngp.TestbedMode.Nerf
testbed = ngp.Testbed(mode)
testbed.load_snapshot("ring_snap.msgpack")
testbed.aabb = ngp.BoundingBox([0.320, 0.320, 0.320], [0.680, 0.680, 0.680])
def round_up_to_base(x, base=10):
    return x + (base - x) % base

def get_marching_cubes_res(res_1d: int, aabb:  ngp.BoundingBox ) -> np.ndarray:
	scale = res_1d / (aabb.max - aabb.min).max()
	res3d = (aabb.max - aabb.min) * scale + 0.5
	res3d = round_up_to_base(res3d.astype(np.int32), 16)
	return res3d

mc = testbed.compute_marching_cubes_mesh(resolution=get_marching_cubes_res(512, testbed.aabb), aabb=testbed.aabb, thresh=2)


vertex = np.array(list(zip(*mc["V"].T)), dtype=[('x', 'f4'), ('y', 'f4'), ('z', 'f4')])
vertex_color = np.array(list(zip(*((mc["C"] * 255).T))), dtype=[('red', 'u1'), ('green', 'u1'), ('blue', 'u1')])

n = len(vertex)
assert len(vertex_color) == n

vertex_all = np.empty(n, vertex.dtype.descr + vertex_color.dtype.descr)

for prop in vertex.dtype.names:
    vertex_all[prop] = vertex[prop]

for prop in vertex_color.dtype.names:
    vertex_all[prop] = vertex_color[prop]

ply = PlyData([PlyElement.describe(vertex_all, 'vertex')], text=False)

ply.write('nerf_pc.ply')

but it's not work well, I just got Sparse Pointcloud...😭
Next, I tried to export the Mesh(obj) with this Python code not PCL.

and i want mesh object. so tried this code.

python3 ./scripts/run.py --mode nerf --scene ./data/nerf/fox/ --save_snapshot saved/fox.msgpack --save_mesh saved/fox.ply --gui --train

However, the resulting obj file was different from the result exported from the gui.
I think the reason is that the aabb range cannot be set.

1. How can i export pointcloud seems like testbed?
2. How can i properly export a mesh in no gui?

finally, i want to show 3d object in web browser...

[kafei123456]

Excuse me, have you solved the problems?

[nooskuyh]

No, i can't. it's impossible question. because point clouds that the model makes is only specific presentation. (not include point of view that we can't see). so i recommend you to look up MobileNerf Model.

…

________________________________ From: kafei123456 ***@***.***> Sent: Wednesday, September 13, 2023 5:46 PM To: NVlabs/instant-ngp ***@***.***> Cc: Smashh712 ***@***.***>; State change ***@***.***> Subject: Re: [NVlabs/instant-ngp] PCL(Point Cloud) export (Discussion #702) Excuse me, have you solved the problems? — Reply to this email directly, view it on GitHub<#702 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ALLTY6FMMN2NCHWLRGFOLELX2FXFPANCNFSM5ZGWHWYQ>. You are receiving this because you modified the open/close state.Message ID: ***@***.***>

[kafei123456]

Oh, But MobileNerf need to many GPU. I don't know how to train it using only one GPU.