Camera extrinsics and intrinsics on same path does not work for depth images

[roym899]

Describe the bug
#2568 added the option to log extrinsics + intrinsics (+ image) on the same path. It works fine for RGB images, however for depth images it does not work, even when the depth image is on a separate path.

This works:

rgbd_camera <- Transform3D
rgbd_camera/image/ <- Pinhole
rgbd_camera/image/depth <- DepthImage

These do not work

rgbd_camera <- Transform3D, Pinhole
rgbd_camera/depth <- DepthImage
and
rgbd_camera <- Transform3D, Pinhole, DepthImage

To reproduce

import numpy as np
import rerun as rr
import rerun.experimental as rr2
from rerun.experimental import dt as rrd

rr.init("depth_camera", spawn=True)
rr2.log(
    "world/rgbd_camera",
    rrd.TranslationAndMat3x3(translation=[10.0, 0.0, 0.0], matrix=np.eye(3)),
)
rr.log_pinhole("world/rgbd_camera", height=480, width=640, focal_length_px=500.0)
rr2.log("world/rgbd_camera", rr2.DepthImage(np.random.rand(480, 640)))

gives

while

import numpy as np
import rerun as rr
import rerun.experimental as rr2
from rerun.experimental import dt as rrd

rr.init("depth_camera", spawn=True)
rr2.log(
    "world/rgbd_camera",
    rrd.TranslationAndMat3x3(translation=[10.0, 0.0, 0.0], matrix=np.eye(3)),
)
rr.log_pinhole("world/rgbd_camera/image", height=480, width=640, focal_length_px=500.0)
rr2.log("world/rgbd_camera/image/depth", rr2.DepthImage(np.random.rand(480, 640)))

gives

Expected behavior
Should work similar to color images. Ideally color and depth on same path would also be supported, but if that's not possible, I'd expect

rgbd_camera <- Transform3D, Pinhole
rgbd_camera/rgb <- Image
rgbd_camera/depth <- DepthImage

to work.

Desktop (please complete the following information):

• OS: Ubuntu 20.04

Rerun version

rerun_py 0.9.0-alpha.4 [rustc 1.72.0 (5680fa18f 2023-08-23), LLVM 16.0.5] x86_64-unknown-linux-gnu 7db7b54, built 2023-09-12T08:50:21Z