WebRTC fails to initialize

[mcres]

Description

I am trying to set up Isaac Sim with WebRTC over the Internet in a Docker container on my headless server:

• The drivers version are as specified both in the Isaac Sim and Omniverse Kit documentation ✔️
• The ./isaac-sim.compatibility_check.sh script passes ✔️
• I execute /runheadless.sh -v --/app/livestream/publicEndpointAddress=IP --/app/livestream/port=49100, as specified in the documentation ✔️
• The script prints that Isaac Sim Full Streaming App is loaded ✔️
• Neither 47998 nor 49100 ports are open by the container ❌
• The Isaac Sim WebRTC client obviously shows nothing ❌

Both software and hardware requirements are fulfilled and I have followed the steps provided in the documentation.

However, it seems that the omni.kit.livestream.webrtc and carb.livestream-rtc.plugin extensions are somehow failing.

I am not able to diagnose the system further than what is exposed on the Additional Information section. Also, I cannot find information about carb.livestream-rtc.plugin. Help is much appreciated.

Isaac Sim version

5.1.0

Operating System (OS)

Ubuntu 24.04

GPU Name

L40S

GPU Driver and CUDA versions

Driver Version: 580.95.05, CUDA Version: 13.0

Logs

Here is the log: kit_20251124_151529.log

The relevant part is the following:

2025-11-24T15:15:35Z [6,585ms] [Info] [carb.livestream-rtc.plugin] Stream Server: capture queue disabled
2025-11-24T15:15:35Z [6,585ms] [Info] [carb.livestream-rtc.plugin] Stream Server: Video stream created
2025-11-24T15:15:35Z [6,585ms] [Info] [carb.livestream-rtc.plugin] Stream Server: input stream created
2025-11-24T15:15:35Z [6,585ms] [Info] [carb.livestream-rtc.plugin] Stream Server: audio stream created
2025-11-24T15:15:36Z [6,957ms] [Error] [carb.livestream-rtc.plugin] Stream Server: Net Stream Creation failed, 0x800E8401
2025-11-24T15:15:36Z [6,957ms] [Error] [carb.livestream-rtc.plugin] Could not initialize streaming components
2025-11-24T15:15:36Z [6,957ms] [Error] [carb.livestream-rtc.plugin] Couldn't initialize the capture device.

Additional information

I can isolate WebRTC and replicate the same errors in the Isaac Sim 5.1.0 container as follows:

/isaac-sim/kit/kit \
    --enable omni.kit.livestream.webrtc \
    --no-window

However, here I also get a warning perhaps related to the issue, regarding CudaInterop version:

[2.779s] [ext: omni.kit.streamsdk.plugins-7.7.2] startup
[2.779s] [ext: omni.kit.livestream.core-7.5.1] startup
[2.782s] [ext: omni.kit.livestream.webrtc-7.0.0] startup
Warning: Possible version incompatibility. Attempting to load carb::cudainterop::CudaInterop with version v0.17 against v0.15.

Failed to open [/var/run/utmp]
Active user not found. Using default user [kiosk]2025-11-26T15:58:50Z [3,110ms] [Error] [carb.livestream-rtc.plugin] Stream Server: Net Stream Creation failed, 0x800E8401
2025-11-26T15:58:50Z [3,110ms] [Error] [carb.livestream-rtc.plugin] Could not initialize streaming components
2025-11-26T15:58:50Z [3,110ms] [Error] [carb.livestream-rtc.plugin] Couldn't initialize the capture device.

I can also replicate the error on a 106.5.0 Omniverse Kit image.

[mcres]

@sheikh-nv @vick-yu I would really appreciate some help trying to find the root cause of this issue. This is preventing my organization to move forward with many projects.

I am trying to isolate this using the omni.kit.livestream.webrtc extension in an Omniverse Kit container, but I am not sure how. GPU- and system-wise everything seems fine.

[sheikh-nv]

Hi. It could be a networking issue.

Try using --network=host when running the container and open ports 49100 and 47998 on the host machine. Also add those ports on the AllowList if the host is behind a firewall. We recommend to allow connections to that host's ports to a specific set of remote Public IP addresses for security.

When using --/app/livestream/publicEndpointAddress, make sure it is the public IP address of the host.

[mcres]

@sheikh-nv networking was not the issue at all. Thanks for the support, though.
Here is how I solved this, in case someone find the same issue.

Clearly, the WebRTC was the issue. I isolated this by creating an Omniverse container and enabling the corresponding extension:

# In the host
# Build an image from nvcr.io/nvidia/omniverse/ov-kit-kernel:106.5.0

# In the Omniverse container
/opt/nvidia/omniverse/kit-kernel/kit \
    --enable omni.kit.livestream.webrtc \
    --no-window

This was failed as shown above.

A capture device in Omniverse jargon does the following:

1. Takes the rendered output from a Viewport (e.g. an Isaac Sim scene)
2. Encodes that video using NVENC so that WebRTC can efficiently stream it

It seemed that my Isaac Sim container was rendering some output, based on the logs produced.
A sanity check for the NVIDIA encoders can be done using ffmpeg (AFAIK this is the simplest, more straightforward way):

# Download a sample MP4 file from e.g.
# https://file-examples.com/index.php/sample-video-files/sample-mp4-files/
ffmpeg -hwaccel vulkan -i input.mp4 -c:v h264_nvenc -preset fast out.mp4

This was failing as follows:

[h264_nvenc @ 0x5f1296588b40] Cannot load libnvidia-encode.so.1

Once the related libraries were installed in the host, everything ('ffmpeg`, WebRTC isolated extension and Isaac Sim over WebRTC) was working.