Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug Report] WebRTC streaming does not work on Orbit scripts with Isaac Sim 2023.1.1 #268

Closed
2 tasks done
ozhanozen opened this issue Mar 7, 2024 · 2 comments
Closed
2 tasks done
Labels
duplicate This issue or pull request already exists invalid This doesn't seem right

Comments

@ozhanozen
Copy link
Contributor

ozhanozen commented Mar 7, 2024

If I use the 2023.1.1 version of Isaac Sim as a base in Orbit and enable WebRTC livestream on Orbit scripts, WebRTC does not start correctly, and I get the following errors on the terminal:

[ext: omni.kit.livestream.webrtc-2.3.2] startup
[Error] [carb.livestream.plugin] Stream Server: Net Stream Creation failed, 0x800B1000
[Error] [carb.livestream.plugin] Could not initialize streaming components
[Error] [carb.livestream.plugin] Couldn’t initialize the capture device.
[ext: omni.services.streamclient.webrtc-1.3.8] startup

Steps to reproduce

Run random_ageny.py with WebRTC enabled (livestream=3) on any environment.

System Info

  • Commit: [93f3eff]
  • Isaac Sim Version: [2023.1.1]
  • OS: [Ubuntu 20.04]
  • GPU: [RTX A6000]
  • CUDA: [12.0]
  • GPU Driver: [525.60.11]

Additional context

WebRTC works correctly with Orbit scripts if the Isaac Sim version is 2023.1.0-hotfix.1. The problem is specific to the 2023.1.1 version.

Interestingly, even on version 2023.1.1, running directly runheadless.webrtc.sh from the container successfully enables the WebRTC. Hence, the problem is most probably related to Orbit.

Checklist

  • I have checked that there is no similar issue in the repo (required)
  • I have checked that the issue is not in running Isaac Sim itself and is related to the repo

Acceptance Criteria

  • WebRTC livestream works with orbit scripts
ADebor pushed a commit to ADebor/IsaacLab that referenced this issue Apr 8, 2024
# Description

The Nucleus directory for materials has changed in 2023.1. They are now
directly inside `NVIDIA/Materials` instead of `NVIDIA/Assets/Materials`.
This MR fixes the referenced directory.

## Type of change

- Bug fix (non-breaking change which fixes an issue)

## Screenshots

This is how the rough terrain looks like now:

![shingle_ground](https://github.com/isaac-orbit/orbit/assets/12863862/c561f664-22bb-45d1-a713-9d95ec48feda)

## Checklist

- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./orbit.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [x] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file
- [x] I have added my name to the `CONTRIBUTORS.md` or my name already
exists there
@ozhanozen
Copy link
Contributor Author

ozhanozen commented Apr 22, 2024

Update: it seems like the problem is not specific to Orbit, as the livestream.py example of Isaac Sim also fails the same way when WebRTC is enabled.

I wonder if there is a workaround we could implement in Orbit.

@Mayankm96
Copy link
Contributor

Closing this issue to continue the discussion in #381.

@Mayankm96 Mayankm96 added duplicate This issue or pull request already exists invalid This doesn't seem right labels Apr 26, 2024
fatimaanes pushed a commit to fatimaanes/omniperf that referenced this issue Aug 8, 2024
# Description

The Nucleus directory for materials has changed in 2023.1. They are now
directly inside `NVIDIA/Materials` instead of `NVIDIA/Assets/Materials`.
This MR fixes the referenced directory.

## Type of change

- Bug fix (non-breaking change which fixes an issue)

## Screenshots

This is how the rough terrain looks like now:

![shingle_ground](https://github.com/isaac-orbit/orbit/assets/12863862/c561f664-22bb-45d1-a713-9d95ec48feda)

## Checklist

- [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with
`./orbit.sh --format`
- [x] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [x] I have updated the changelog and the corresponding version in the
extension's `config/extension.toml` file
- [x] I have added my name to the `CONTRIBUTORS.md` or my name already
exists there
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duplicate This issue or pull request already exists invalid This doesn't seem right
Projects
None yet
Development

No branches or pull requests

2 participants