Repository navigation
Summary
1. Tasks and Assets
New Tasks
| Task IDs | Description |
|---|---|
spacewalk, spacewalk_eva, spacewalk_iva |
Humanoid (default Unitree G1) follows a waypoint path outside the ISS and Gateway (EVA) or inside the Kibo module (IVA) |
moonfall |
Heavy Peregrine lander with onboard event camera: deployment stage, then several landing phases |
terrain_landscaping, terrain_landscaping_crater, terrain_landscaping_mound |
RaphRover with RaphShovel on a regolith bed tasked with moving granular particles around; no trained policy is included |
formation_following, formation_following_orbital, formation_following_decentralized |
Three Cadre rovers hold a formation around a moving center under one shared policy; orbital: CubeSats in microgravity; decentralized: per-rover policy views |
beam_transport |
Two Spot robots carry a rigid beam to a target |
traversal |
Articulated rover with actuated steering and suspension drives a straight line at a target velocity over challenging terrain |
aerial_navigation |
Ingenuity flies to a moving waypoint, keeping clearance above the terrain |
flight |
Ingenuity ascent, transfer, landing |
modular_assembly |
Arm assembling modular elements (e.g. three LEGO blocks) |
lunalab, zerog_lab |
Inspired by LunaLab and Zero-G Lab at the University of Luxembourg; not validated against the real facilities |
excavation_demo |
Manual-control excavation with a Kinova Gen3 N7 arm |
Example CLI commands:
srb ls env
srb ls --live env
srb agent teleop -e spacewalk_iva
srb agent zero -e spacewalk env.mode=iva env.use_waypoint_path=false
srb agent zero --headless -e moonfall --record-events 'env.active_sensors=[proprioception,contact,transform,events]'
srb agent teleop -e terrain_landscaping_crater env.num_envs=1
srb agent rand -e formation_following
srb agent zero -e formation_following_orbital
srb agent zero -e beam_transport env.beam_kinematic_mount_enabled=false
srb agent teleop -e traversal
srb agent teleop -e aerial_navigation
srb agent rand -e flight env.landing_only=true
srb agent teleop --env excavation_demo env.scenery=lunalab env.demo_regolith_quality=visual
srb agent teleop -e modular_assembly
srb agent teleop -e lunalab
srb agent teleop -e zerog_labUpdated Rewards
Every task has a new env.reward block with terms configurable from CLI. Existing tasks were re-tuned, so results are not directly comparable with 0.0.6.
srb agent teleop -e landing env.reward.penalty_crash.weight=-50
srb agent teleop -e landing 'env.active_sensors=[proprioception,contact,transform,events]'
srb agent zero -e waypoint_navigation env.sim_to_real_profile=waypoint_navigation_synthetic_v1
srb agent teleop -e orbital_evasion env.num_obstacles=8 env.obstacle_scale=3.0New Assets
| Kind | Assets |
|---|---|
| Ground robots | cadre, husky, nifty, raph_rover |
| Aquatic robots | heron |
| Orbital robots | floating_platform, int_ball1, int_ball2 |
| Multi-arm robots | levion_arms, zeroglab_arms |
| Tools and payloads | raph_shovel, husky_payload_lunalab |
| Objects | beam, bolt_m8_tight, nut_m8_tight, projector_light, lego_block_{1x1,1x2,1x3,1x4,2x2,2x3,2x4}, random_lego_block |
| Sceneries | iss_gateway_scenery, kibou, zeroglab, plane, terrain_generator |
| Removed objects | bag, juggling_ball |
srb ls robot
srb agent teleop -e _ground_manipulation env.robot=husky+ur10+robotiq_hand_e2. Environment Features
- Sensors:
env.active_sensorsselects categoriesproprioception,contact,transform,visual,tactile,terrain,event_camera(aliasevents),custom; default[proprioception,contact,transform] - Observations:
--obs {state,visual}forteleop,collect,train,eval;--obs visualfails preflight in 0.1.0 becausehyperparams/visual_profiles.yamldoes not ship - Actions: named per-robot action modes, selected with
env.robot.action_mode; new ones includesmooth_osc,drive_filtered, and thruster control.smooth_oscand the Kortex interface share rate, critically damped, and jerk filters;drive_filteredandros_cmd_velshare rate and critically damped filters (ros_cmd_velonly withfilter_enabled, off by default). The environment'ssrb_spec.actiondescribes the action layout - Wrappers: per-run observation stacking and action smoothing
- Privileged observations:
env.expose_privileged=trueadds astate_privilegedgroup toexcavation(on by default inexcavation_demo), and each RL preset decides which networks see it.onnx_export_input_whitelist()andassert_privileged_absent_from_onnx()insrb.core.envcheck that it stays out of exported ONNX policies; exporters do not call them - Randomization: events carry a category (
visual,physics,task,sensor,lifecycle, or the defaultuntagged) - Debugging:
env.hud=true(in-simulation HUD),--snapshot(save one PNG after reset, then exit),--enable_cameras(render cameras without recording video) - Teleoperation: gamepad uses Isaac Lab's native driver instead of ROS; SpaceMouse discards stale motion after failed reads or 0.5 s without input;
--no-invert_controlsdisables control inversion
srb agent rand -e _manipulation env.robot.action_mode=joint_pos_rel
srb agent train --algo sbx_ppo -e landing env.observation_stacking.enable=true env.observation_stacking.n=4
srb agent teleop -e landing env.action_smoothing.enable=true
srb agent teleop -e waypoint_navigation env.hud=true
srb agent zero -e excavation_demo --headless --snapshot out.png --snapshot-warmup 32Scene, Camera, and Physics Settings
New env.* settings, except delays:
- Cameras:
env.camera_resolution(default[64,64]),env.camera_data_types(default[rgb,depth]),env.camera_clipping_range(near and far planes),env.camera_record=true(per-episode videos toenv.camera_record_dir) - Regolith particles (
docs/src/config/particles.md):env.particles_spawner(pile shapegrid,pyramid,crater_pile, ormound_pile);env.particles_density,env.particles_friction,env.particles_damping(value or[min,max]range);env.particles_freeze=true(freeze once settled);env.particles_conform_to_terrain=true(snap onto terrain);env.particles_pile_center_jitter(shift pile each reset) - Multi-robot layout:
env.robot_spacing,env.robot_positions,env.robot_spawn_height - Scenery and lighting:
env.sunlight_rpy(fixed sun orientation in degrees; conflicts withenv.ephemeris),env.scenery_flat_area_size(flattened central area of procedural terrain) - Delays (existed in 0.0.6, now validated):
env.action_delay_steps,env.observation_delay_steps(fixed value or[min,max]range)
srb agent teleop -e peg_in_hole 'env.active_sensors=[proprioception,contact,transform,visual]' 'env.camera_resolution=[128,128]' env.camera_record=true
srb agent zero -e excavation --headless env.particles_spawner=pyramid env.particles_freeze=true --snapshot out.png
srb agent teleop -e _ground 'env.sunlight_rpy=[0,30,90]' env.scenery_flat_area_size=20
srb agent rand -e waypoint_navigation 'env.action_delay_steps=[0,2]' 'env.observation_delay_steps=[0,2]'3. Learning
Algorithms
New: tdmpc2, rsl_rl_ppo, Robomimic imitation learning.
- RL (27):
dreamer,tdmpc2,sb3_{a2c,ars,crossq,ddpg,ppo,ppo_lstm,sac,td3,tqc,trpo},sbx_{crossq,ddpg,ppo,sac,td3,tqc},rsl_rl_ppo,skrl_{a2c,ddpg,ppo,ppo_rnn,rpo,sac,td3,trpo} - Imitation learning (11):
robomimic_{bc,bc_rnn,bc_transformer,bcq,cql,iql,td3_bc,gl,hbc,iris,diffusion_policy}
train and tune accept RL only, learn imitation learning only, and eval, collect, teleop both. Default hyperparameters changed (notably skrl sac, td3, ddpg, ppo), so results are not directly comparable with 0.0.6.
Dreamer
Dreamer trains in worker processes and can save its replay buffer for resumable runs.
srb agent train --headless --algo dreamer --env waypoint_navigation env.robot=leo_rover env.num_envs=1 env.domain=earth env.scenery=oberpfaffenhofen
srb agent train --headless --algo dreamer --env landing env.num_envs=1 agent.replay.save=true agent.replay.save_wait=true
srb agent train --headless --algo dreamer --env landing --continue_trainingTD-MPC2
No --continue_training; --model imports weights only. Parallel environments on tasks with early termination are supported but not yet validated. Terrain-landscaping tasks are rejected.
srb agent train --headless --algo tdmpc2 --env landing env.num_envs=16
SRB_EVAL_EPISODES=100 SRB_EVAL_OUT=/tmp/eval.json srb agent eval --algo tdmpc2 --env landing env.num_envs=16 agent.mpc=falseData Collection and Robomimic Offline Learning
srb agent collect --collector {human,policy,random,zero} records demonstrations with env.num_envs=1, defaulting to policy when --algo or --model is given, else human (teleoperation); policy collection and eval load the latest trained run of --algo for the task unless --model PATH is given. Flag --success_only discards failed episodes and needs a task that reports success (excavation, modular_assembly, beam_transport, flight, formation_following, terrain_landscaping, spacewalk); autonomous collectors give up after 3 × --num_episodes attempts. srb agent learn trains offline from --dataset without Isaac Sim.
srb agent collect --env peg_in_hole --num_episodes 50 env.num_envs=1
srb agent collect --env peg_in_hole --teleop_device ros --num_episodes 50 env.num_envs=1
srb agent collect --env peg_in_hole --algo sb3_ppo --num_episodes 200 env.num_envs=1
srb agent collect --env excavation --collector zero --num_episodes 5 --horizon 200 env.num_envs=1
srb agent learn --algo robomimic_bc_rnn --env peg_in_hole --dataset /path/to/demos.hdf5 --num_epochs 500 --normalize_actions
srb agent eval --algo robomimic_bc_rnn --env peg_in_hole env.num_envs=1Demonstration-Prefilled RL
skrl_sac, skrl_ddpg, skrl_td3, and dreamer can prefill the replay buffer from demonstrations.
srb agent train --algo skrl_sac --env peg_in_hole --demo-dataset /data/peg_in_hole_canonical --demo-max-transitions 1000 env.num_envs=1 agent.memory.memory_size=8192Optuna Hyperparameter Tuning
srb agent tune subcommands: run, status, export, repair, baseline, check, validate. Search spaces: skrl ppo, ppo_rnn, sac; sb3 and sbx ppo, sac, tqc, td3, crossq; rsl_rl_ppo, dreamer, tdmpc2. Other RL algorithms fail at runtime without a search space. Overrides use --pin KEY=VALUE, and the environment count --trial-num-envs. tune export writes into hyperparams/.
srb agent tune check --env sample_collection --algo skrl_ppo --trial-steps 10_000_000 --fps 50000
srb agent tune run --env sample_collection --algo skrl_ppo --trial-steps 19_968_000 --n-trials 40 --n-workers 2 --gpus 0,1
srb agent tune export --study srb-skrl_ppo-state-sample_collection-v1 --to task --dry-runModel Artifacts and Publishing
srb model push publishes artifacts to the Hugging Face Hub; eval and collect infer --algo from an artifact.
srb agent train --algo rsl_rl_ppo --env excavation --model-artifact-output /models/srb_excavation_rsl_rl_ppo --model-artifact-task excavation
srb model from-run logs/excavation/rsl_rl_ppo/RUN_DIR --dataset /data/srb_excavation_policy --output /models/m
srb model validate /models/m --strict
srb model push /models/m --dry-run
srb agent eval --env excavation --model /models/m
srb agent collect --env excavation --model /models/m env.num_envs=14. Sim-to-Real
Generating Real-Robot Environments
srb real_agent gen (alias sim2real_gen) generates real-robot environments from simulated tasks; --env ALL generates all cached environments.
srb real_agent gen --env waypoint_navigation env.robot=leo_rover --hardware ros_cmd_vel ros_tf ros_mw
srb real_agent gen --env terrain_landscaping_crater --check # print a diff against the checked-in module; fail on drift without writingHardware interfaces (15):
- Generic ROS 2:
ros_cmd_vel,ros_tf,ros_imu,ros_image,ros_mw - Perception and targets:
ros_depth_heightmap,ros_optitrack,ros_target_patch,ros_scoop_target,ros_formation_following_observation - Manipulators:
ros_kortex_cartesian,ros_kortex_joint_vel,moveit_servo,moveit_gripper - Testing:
dummy
Deployment
Runtime zero, rand, teleop, ros, train, eval, collect operate on the shipped real-robot environments excavation, formation_following, terrain_landscaping, terrain_landscaping_crater, and waypoint_navigation. Real-robot teleoperation runs without Isaac Sim and supports only the ros (default), spacemouse (needs srb[hw], included in all), and haptic devices. Only dreamer is allowed to train on real hardware for now (experimental continual learning on the robot), as the rest is not validated.
srb real_agent teleop --env waypoint_navigation --teleop_device spacemouse
srb real_agent eval --env waypoint_navigation --algo dreamer # latest trained run, or pass --model
srb real_agent collect --env waypoint_navigation --collector random --num_episodes 5
srb real_agent train --env waypoint_navigation --algo dreamer --continue_trainingValidation and Reporting
srb real_agent validate runs a profile from hyperparams/validation/ on the robot and reports pass or fail. Robot runs need --checkpoint unless the profile sets one (the shipped profiles use REQUIRED_AT_RUNTIME); --dry-run needs none, checks only the spec and session setup, and exits 4 once the spec loads.
srb real_agent validate --spec hyperparams/validation/formation_following.yaml --dry-run
srb real_agent validate --spec hyperparams/validation/formation_following.yaml --checkpoint CHECKPOINT --episodes 10
srb real_agent rebuild-summary SESSION_DIR
srb real_agent replay-twin --session SESSION_DIR --baseline BASELINE.rrdROS 2 Interface
- New
action/rawtopic (std_msgs/Float64MultiArray) carries the flat action vector; single-environment topics drop theenv0/prefix. - QoS is best-effort with depth 1, commands expire after 0.5 s, and resets apply after the next step.
--ros_syncwaits for a fresh action at every step after the first;--ros_action_timeoutlimits that wait in simulation and sets the startup wait and command lifetime forreal_agent ros;--ros_unthrottledremoves simulation pacing but not the RealEnv action rate.- By default,
real_agent roswaits 5 s for the first message; it aborts on missing or invalid input instead of sending zero actions.
srb agent ros -e waypoint_navigation --ros_sync --ros_action_timeout 2.0 # simulation
srb real_agent ros --env waypoint_navigation --ros_sync --ros_action_timeout 2.0 # real robot5. Terrain, Ephemeris, Sensors, and Data
Real Terrain from Orbital Data
| Body | Elevation | Imagery |
|---|---|---|
| Moon | LOLA DEMs (PGDA), LROC NAC DTMs, ShadowCam DTMs, shape-from-shading DEMs | LROC NAC and WAC mosaics, ShadowCam mosaics |
| Mars | MRO HiRISE DTMs, CTX DEMs | HiRISE orthoimages |
| Earth (analog sites) | Copernicus GLO-30, USGS 3DEP | — |
Curated sites (lunar_site_apollo17, martian_site_jezero, …): apollo15 and apollo17 (LROC NAC DTMs), jezero (CTX DEM, 20 m), jezero_v2 (HiRISE DTM and orthoimage, 1 m). Any latitude/longitude region up to 8 km covered by these sources can also be fetched, or your own DEM baked. A source layer whose estimated fetch exceeds 1 GiB needs SRB_TERRAIN_LARGE_OK=1 and catalog approval (allow_large_download: true); v1 curated sites (apollo15, apollo17, jezero) do not need the variable. Large downloads can fail while NASA's server is unstable (see Known Issues). srb asset stack previews offline which sources would be fused; --num-locations downloads several nearby regions.
# List, download, and generate a new terrain based on region latitude/longitude and size
srb asset list terrain --body moon
srb asset download terrain apollo17 --lod medium
SRB_TERRAIN_LARGE_OK=1 srb asset download terrain --body moon --lat -89.66 --lon 0.0 --size-m 2000
SRB_TERRAIN_LARGE_OK=1 srb asset download terrain --lat -89.66 --lon 0.0 --size-m 2000 --num-locations 8 --location-spread-m 3000
srb asset stack --body moon --lat -89.46 --lon 137.3 --size-m 2000 --json
srb asset bake terrain --dem ./my_dem.tif --body moon --site-name my_site --attribution NASA/LROC
srb asset doctor terrain jezero --body mars --lod low # exits 1 and prints the fix if the site is not baked
# Use real terrain in a task
srb agent teleop -e _ground env.domain=mars env.scenery=martian_site_jezero
SRB_TERRAIN_LARGE_OK=1 srb agent teleop -e _ground env.domain=moon env.scenery.body=moon env.scenery.lat_deg=-89.66 env.scenery.lon_deg=0.0 env.scenery.size_m=2000Ephemeris
Sun and Earth positions come from real ephemerides for a given site and epoch. Opt-in env.ephemeris options:
expose_observations=trueaddsobs["ephemeris"], but crashes in 0.1.0 (see Known Issues)eclipse=truedims the Sun when a body such as Earth blocks it;drive_skydome=true(withdrive_sunlight=true, surface domains only) rotates the skydome with the Sun- Orbital tasks can use a circular-orbit observer, configured in Python only
srb ephemeris download
srb ephemeris info --body moon --lat -89.66 --lon 0.0 --utc 2026-11-01T12:00:00 --bodies sun,earth
srb agent teleop -e _ground env.ephemeris.enabled=true env.ephemeris.epoch.utc=2026-11-01T12:00:00
srb agent teleop -e _ground env.ephemeris.enabled=true env.ephemeris.eclipse=true
srb ephemeris import --source pgda-lpsr --input lpsr.tif --out illumination.npz --crs "IAU_2015:30135" --center-xy 0.0,10309.969398639505 --size-m 4000 --gsd-m 5.0 --lat -89.66 --lon 0.0Event Camera
Enable with events in env.active_sensors. The simulated camera emits raw events (x, y, timestamp, polarity) from simulator frames, modelling a Sony IMX636 whose presets set contrast thresholds, bandwidth, leak, shot noise, and refractory period. It is not yet calibrated against real recordings. SRB adds hot pixels for every backend except noop. Policies consume events as a raw list or as voxel_grid, histogram, time_surface, or stacked tensors.
| Backend | Preset use | Setup |
|---|---|---|
v2e (default) |
Full preset | srb[event-v2e] and pinned source (see docs/src/sensors/event_camera.md) |
v2e_streaming |
Requires shot noise 0 | srb[event-v2e], pinned source, and SRB patch (python -m srb.core.sensor.event_camera.backends.v2e_install --apply) |
metavision |
Thresholds and refractory period only | srb[event-metavision] and provider installed manually |
v2ce (learned model) |
Ignores the preset | srb[event-v2ce] and provider installed manually; checkpoint from srb event-camera fetch-weights --mirror hf-andrejorsula-v2ce, set as v2ce_model_path |
noop (for tests) |
New commands include srb dataset export-zenodo-bundle, export-raw-evt3, validate-events reconstruction, and srb event-camera fetch-fixture (real reference recordings). RAW EVT3 and ROS bag exports reject record-events output.
srb event-camera backends --detailed
# Record in simulation
srb agent zero --headless --env velocity_tracking --record-events 'env.active_sensors=[proprioception,contact,transform,visual,events]'
srb agent collect --headless --env velocity_tracking --collector random --num_episodes 5 --horizon 50 env.num_envs=1 'env.active_sensors=[proprioception,contact,transform,visual,events]' --record-events
# Dataset tooling
srb dataset record-events --output events --backend noop --seed 42
srb dataset validate-events stats --synth synthetic.h5 --real recorded.h5 --output stats.json
srb dataset export-lerobot-v3 events/RUN_DIR --output ./bundles/lerobot
srb dataset import-raw-evt3 X.raw --output X.h5 --task landing
srb dataset export-rosbag X.h5 --output ./bag --msg-type event_camera_msgs # needs srb[event-ros]; fails on ROS 2 Jazzy (see Known Issues)Standard Dataset Format
srb dataset export formats: srb_jsonl, robomimic_hdf5, lerobot. push and pull use the Hugging Face Hub.
srb dataset validate /data/srb_excavation --deep --strict
srb dataset compatibility /data/srb_excavation --algo robomimic_bc --purpose train
srb dataset export /logs/excavation/collect/datasets/demos.hdf5 --output /data/srb_excavation_policy --format srb_jsonl
srb dataset replay DATASET --backend rerun --save out.rrd
srb dataset pull --repo-id org/name --dry-run6. CLI, GUI, and Infrastructure
Commands
| 0.0.6 | 0.1.0 |
|---|---|
agent, real_agent, list/ls, gui, repl/python, docs, test |
agent, real_agent, list/ls, dataset, model, asset/assets, event-camera, ephemeris, cache, gui, isaac/isaacsim, doc/docs, test, clean, completions |
Command modules load lazily, so srb --help starts quickly. Only agent, real_agent, and the forwarding commands (gui, isaac, test, and doc with no action, serve, or build) accept arguments after --; agent learn, agent tune, doc docgen, and doc thumbnail reject them. A missing optional feature prints the exact pip install 'srb[<extra>]' fix.
srb cache status --json --strict # also: update, doctor, claim-clean-root
srb clean srb -y # targets: all | isaacsim | simforge | srb
srb isaac python -- -m pip list
srb isaac sim -- --no-window
srb doc docgen --static-only # also: serve, build, thumbnail
srb test --tier unit # tiers: all | unit | workflows (workflows need Isaac Sim)
srb agent zero -e _manipulation --repl # attach a REPL; replaces `srb repl`Tab Completion
Tab completion is now everywhere! It completes commands, flags, task IDs, algorithms, and Hydra overrides (env.* always, agent.* once --algo is set) in Fish, Bash, and Zsh, including inside the Docker image. Override completion needs jq on the host.
srb completions generate # build the completion cache (launches Isaac Sim)
srb completions install # install the Fish/Bash/Zsh completion scripts
# Type a partial override, then press Tab twice:
srb agent zero -e peg_in_hole env.<Tab><Tab>
srb agent train --algo dreamer -e landing agent.replay.<Tab><Tab>Configuration and Rendering
Hydra overrides can also come from a YAML file via --cfg. Rendering modes are now RTX presets applied after Kit starts; the old apps/rendering_modes/*.kit files are gone.
srb agent zero -e peg_in_hole --cfg ./my_overrides.yaml
srb agent zero -e peg_in_hole env.seed=1 env.seed=2 env.num_envs=4 # env.seed=2 is applied
srb agent zero -e excavation_demo --headless --rendering_mode performanceGUI
New Tasks, Session, and Metrics pages; a Configure window that previews and copies the equivalent CLI command; a reward plot from /gui/reward; a footer theme toggle and episode recording; a recovery page when the catalog cache is invalid (srb cache update refreshes it). srb gui uses a prebuilt binary from SRB_GUI_BINARY if set, or when Cargo is unavailable; otherwise it builds with cargo run. Only the rand, teleop, and zero workflows are supported.
srb gui
SRB_GUI_BINARY=/path/to/gui srb guiEnvironment Variables
| Variable | Purpose |
|---|---|
SRB_EVAL_EPISODES, SRB_EVAL_OUT |
Episode count and JSON output path for bounded eval; stochastic policies are rejected (Dreamer, TD-MPC2 unless agent.mpc=false, stochastic Robomimic checkpoints or --model artifacts); SKRL only caps its budget |
SRB_CACHE_ROOT |
Cache location (default .cache/ in a source checkout, else $XDG_CACHE_HOME/srb or ~/.cache/srb) |
SRB_TERRAIN_{AUTO_FETCH,CACHE_ROOT,CATALOG_DIR,LARGE_OK} |
Terrain download and cache behavior |
SRB_EPHEMERIS_{AUTO_FETCH,CACHE_ROOT,HF_REPO_ID,TABLE_PRODUCT} |
Ephemeris download and cache behavior |
SRB_REPL, SRB_GUI_BINARY (or SRB_GUI_BIN, SRB_GUI_PATH), SRB_DISABLE_ISAAC_LOG_FILTERS |
REPL attach, GUI binary, and unfiltered Isaac Sim logs |
SRB_DISABLE_OMNI_TELEMETRY, SRB_ENABLE_OMNI_TELEMETRY |
Exclude Kit telemetry extensions; the second overrides the first |
SRB_KORTEX_PASSWORD |
Kortex arm password for sim-to-real; must not be the factory default, and a password in the config is rejected |
SRB_TARGET_PATCH_MAP_PATH (or SRB_TARGET_MAP_PATH) |
Target map for the ros_target_patch interface |
SRB_ALLOW_UNVERIFIED_LANDSCAPING_CHECKPOINT |
Accept Dreamer landscaping checkpoints with missing metadata (not mismatched metadata) |
Docker
# Run the published 0.1.0 image (~27 GB download)
SRB_DOCKER_PROFILE=simulator SRB_DOCKER_IMAGE='ghcr.io/andrejorsula/space_robotics_bench@sha256:631b2cd0c1f56ee63253c7da698db110fbf67b77294753a95cf18eb434a2cabf' ./.docker/run.bash
# Or build the image
SRB_IMAGE_NAME=space_robotics_bench ./.docker/build.bash 6.1.0
# Run a container with GPU and GUI access
SRB_DOCKER_PROFILE=simulator SRB_DOCKER_IMAGE='space_robotics_bench:6.1.0' ./.docker/run.bash
# Run one command non-interactively (CI and scripts)
DOCKER_TTY=false ./.docker/run.bash srb --helpIn the simulator profile, run srb cache update once at the container prompt; the cache persists in the repository's .cache/ unless WITH_DEV_VOLUME=false. SRB_DOCKER_IMAGE must name a local image or one pinned as NAME@sha256:DIGEST, which Docker pulls on first use. SRB_DOCKER_PROFILE sets the container's host access; more than the default safe is opt-in:
| Profile | Grants | Use for |
|---|---|---|
safe (default) |
No network, private IPC, all Linux capabilities dropped; by default no GPU, display, or host mounts | Commands without Isaac Sim, e.g. srb --help; host files only via -v |
simulator |
GPU, X11 display, host network and IPC, Isaac Sim and SimForge cache mounts, shell history, repository read-write at /root/ws; unprivileged, no-new-privileges |
Isaac Sim and everyday work; edits and offline task catalog persist on the host |
trusted-simulator |
simulator plus --privileged and the host's entire /dev |
Hardware passthrough only, e.g. USB devices, SpaceMouse and haptic teleoperation |
ngc |
NVIDIA's official Isaac Sim 6.1 image (nvcr.io/nvidia/isaac-sim, pinned by digest) as UID 1234:1234, repository at /workspace; needs an RTX-class GPU |
Checking SRB against the upstream image; SRB tasks, ROS 2, and Rust untested there |
Warning:
trusted-simulatorgives the container effectively full control of the host. Use it only with an image you built or one pinned by digest.
Per-profile overrides: WITH_GPU, WITH_GUI, WITH_HISTORY, WITH_DEV_VOLUME (true or false); WITH_HOST_NETWORK=false (bridged network); WITH_HOST_IPC=false (private IPC with SRB_DOCKER_SHM_SIZE of shared memory, default 8g). ngc modes: SRB_NGC_MODE=headless (default), webrtc, or gui, or the shorthand profiles ngc-headless, ngc-webrtc, ngc-gui.
SRB_DOCKER_PROFILE=simulator WITH_GUI=false ./.docker/run.bash # headless
SRB_DOCKER_PROFILE=simulator WITH_HOST_NETWORK=false ./.docker/run.bash # Docker bridge network instead of host
SRB_DOCKER_PROFILE=simulator WITH_HOST_IPC=false SRB_DOCKER_SHM_SIZE=16g ./.docker/run.bash
SRB_DOCKER_PROFILE=ngc-webrtc ./.docker/run.bash # NVIDIA image, WebRTC streamingNote: The default
SRB_DOCKER_PROFILEmight be changed to "simulator" in the future.
Breaking Changes
CLI
srb replandsrb pythonare removed; use--repl [ptpython|bpython]on agent commands, orsrb isaac pythonsrb lsdrops-a/--show_hiddenand gains--livesrb agent learnno longer takes simulator flags (--headless,--video, and others) and accepts onlyagent.*overridesreal_agent teleopno longer accepts--algoor--model.--algovalues are now validated strictlysrb gui -- <args>forwards the arguments to the GUI binary instead of Cargo, sosrb gui -- --releaseno longer selects a release build
Tasks and configuration
peg_in_hole_assemblyandmulti_peg_in_hole_assemblyare renamed topeg_in_holeandmulti_peg_in_hole- The 26
*_visualtask variants are removed; addvisualtoenv.active_sensorsinstead (--obs visualneeds a visual profile catalog that does not ship) env.robot.actionsis replaced byenv.robot.action_mode, with shorter mode names (e.g.joint_position_relativebecomesjoint_pos_rel)- Quaternion settings such as
env.tf_quat_targetuse xyzw order instead of wxyz - With
env.num_envs=1, ROS topics drop theenv0/prefix (e.g./srb/reward)
Algorithms and platform
skrl_ampandskrl_cemare removed- Python 3.12, Isaac Sim 6.1.0, Isaac Lab 3.0.0, and Gymnasium 1.x are required; skrl algorithms need skrl 2.x
run.bashno longer falls back to the Docker Hub imageandrejorsula/space_robotics_bench; use a local image or a digest-pinnedSRB_DOCKER_IMAGE
Python API
- Importing
srb.tasksno longer registers tasks; they register once Isaac Sim is running, viaregister_all()orensure_registered(). Generated sim-to-real environments register throughsrb.interfaces.sim_to_real.env.register_all() srb.utils.hydramoved tosrb.hydra- A task's
extract_step_returnmay return an optional fifthinfodict for episode diagnostics srb._typing.enumis renamed tosrb._typing.enum_utils- Asset modules moved into family subpackages (e.g.
srb.assets.robot.mobile.ground); package-level names such asassets.LeoRoverstill work - The Rust library and Python extension crates are removed
Commits
Added
- Docs: Add CLI and operational references (b9acd52) by @AndrejOrsula
- Docker: Add provenance and release workflow (d16f095) by @AndrejOrsula
- Add sim-to-real validation profiles (9407cda) by @AndrejOrsula
- CLI: Add docs, GUI, and maintenance commands (0db991b) by @AndrejOrsula
- CLI: Add dataset, model, sensor, and ephemeris commands (f7e4ba1) by @AndrejOrsula
- CLI: Add asset, cache, and catalog commands (7402b72) by @AndrejOrsula
- CLI: Add lazy command registry and bootstrap (a126014) by @AndrejOrsula
- Add sim-to-real validation and reporting (7abc7c6) by @AndrejOrsula
- Add sim-to-real deployment and hardware interfaces (03a3ac5) by @AndrejOrsula
- Add Optuna studies and search spaces (c2fae0b) by @AndrejOrsula
- Add experiment policy and artifact workflows (77dc8d2) by @AndrejOrsula
- Add event camera dataset export and validation (c4b725b) by @AndrejOrsula
- Add canonical dataset recording and conversion (86f5c16) by @AndrejOrsula
- Add RL framework adapters and policies (cd4ab46) by @AndrejOrsula
- Add Robomimic offline learning (6c45d4a) by @AndrejOrsula
- Add TD-MPC2 training and evaluation (a83e7ef) by @AndrejOrsula
- Add Dreamer training and replay support (ba5f4ea) by @AndrejOrsula
- Add wrapper composition and application bindings (49dd05a) by @AndrejOrsula
- Add Hydra configuration resolution (c2bca30) by @AndrejOrsula
- Add spacewalk task (b118574) by @AndrejOrsula
- Add moonfall task and onboard event camera wiring (f03286d) by @AndrejOrsula
- Add terrain landscaping tasks and manifests (2864d3d) by @AndrejOrsula
- Add ground and orbital formation following (704201d) by @AndrejOrsula
- Add beam transport and traversal tasks (ad931a2) by @AndrejOrsula
- Add aerial navigation and flight tasks (014927c) by @AndrejOrsula
- Excavation: Add demo task and sensor support (9040878) by @AndrejOrsula
- Add lunalab and zerog_lab digital twin tasks (05ed11e) by @AndrejOrsula
- Add terrain landscaping runtime contracts (61a8eda) by @AndrejOrsula
- Add terrain materials, rocks, lighting, and scenes (40124ac) by @AndrejOrsula
- Add terrain fusion, meshes, and augmentation (7f3797c) by @AndrejOrsula
- Add terrain sources, catalogs, and ingestion (71c2859) by @AndrejOrsula
- Add real terrain scenery assets (1c91da7) by @AndrejOrsula
- Add environment specs and structured spaces (9e86332) by @AndrejOrsula
- Add reward and randomization runtime (dfe4c6e) by @AndrejOrsula
- Add event camera and sensor recording support (c6cfcbb) by @AndrejOrsula
- Add ephemeris providers and observation products (6b1ff62) by @AndrejOrsula
- Add action groups, filters, and command mappings (12309b5) by @AndrejOrsula
- Add process supervision and validation utilities (2d9022b) by @AndrejOrsula
- Add artifact, dataset, and model publication utilities (2f0c3ac) by @AndrejOrsula
- Add shared configuration and simulator utilities (8e6bcf7) by @AndrejOrsula
- Add typed configuration and observation contracts (d7e52b3) by @AndrejOrsula
Changed
- Docs: Explain task completion in Docker (ed5ad91) by @AndrejOrsula
- Keep pyspacemouse on 1.x (b88a412) by @AndrejOrsula
- Merge pull request #148 from AndrejOrsula/dependabot/uv/filelock-4.0.12 (483068d) by @AndrejOrsula in #148
- Build(deps): bump filelock from 3.20.3 to 4.0.12 (f06d86d) by @dependabot[bot]
- Merge pull request #149 from AndrejOrsula/dependabot/uv/pyspacemouse-2.1.0 (0ebb277) by @AndrejOrsula in #149
- Build(deps): bump pyspacemouse from 1.1.5 to 2.1.0 (4ac841f) by @dependabot[bot]
- Align opencv-python with opencv-python-headless 5.0 (ca7e0ac) by @AndrejOrsula
- Pin tf/jax and fix Dreamer worker startup (1029255) by @AndrejOrsula
- Merge pull request #146 from AndrejOrsula/dependabot/uv/rich-15.0.0 (a89f7f3) by @AndrejOrsula in #146
- Build(deps): bump rich from 14.2.0 to 15.0.0 (6860ddf) by @dependabot[bot]
- Merge pull request #147 from AndrejOrsula/dependabot/uv/logfire-5.1.1 (1422ba4) by @AndrejOrsula in #147
- Build(deps): bump logfire from 4.41.0 to 5.1.1 (ea1999b) by @dependabot[bot]
- Merge pull request #145 from AndrejOrsula/dependabot/uv/mypy-2.4.0 (64ccd68) by @AndrejOrsula in #145
- Build(deps): bump mypy from 1.19.1 to 2.4.0 (175615e) by @dependabot[bot]
- Merge pull request #144 from AndrejOrsula/dependabot/uv/opencv-python-headless-5.0.0.93 (4c467c2) by @AndrejOrsula in #144
- Build(deps): bump opencv-python-headless from 4.13.0.92 to 5.0.0.93 (08e89d2) by @dependabot[bot]
- Merge pull request #143 from AndrejOrsula/dependabot/uv/trimesh-5.1.1 (e91c140) by @AndrejOrsula in #143
- Build(deps): bump trimesh from 4.12.2 to 5.1.1 (9ab4809) by @dependabot[bot]
- Merge pull request #142 from AndrejOrsula/dependabot/uv/pyarrow-25.0.1 (30cceea) by @AndrejOrsula in #142
- Build(deps): bump pyarrow from 24.0.0 to 25.0.1 (402a065) by @dependabot[bot]
- Build(deps): bump types-pyyaml from 6.0.12.20250915 to 6.0.12.20260906 (b6f019c) by @dependabot[bot] in #140
- Build(deps): bump types-requests from 2.33.0.20260408 to 2.33.0.20261006 (4b03a17) by @dependabot[bot] in #141
- Build(deps): bump the minor-and-patch group with 3 updates (a8b3cd5) by @dependabot[bot] in #139
- Pin jax, optuna, scipy, and matplotlib to versions that work with Isaac Sim (67d0b84) by @AndrejOrsula
- Merge pull request #138 from AndrejOrsula/dependabot/uv/hdf5plugin-7.1.0 (20a8dac) by @AndrejOrsula in #138
- Build(deps): bump hdf5plugin from 6.0.0 to 7.1.0 (fd00593) by @dependabot[bot]
- Merge pull request #135 from AndrejOrsula/dependabot/uv/optuna-5.0.0 (d9985c8) by @AndrejOrsula in #135
- Build(deps): bump optuna from 4.6.0 to 5.0.0 (e292029) by @dependabot[bot]
- Build(deps): bump the minor-and-patch group across 1 directory with 34 updates (59919b9) by @dependabot[bot] in #134
- Build(deps): bump the minor-and-patch group across 1 directory with 3 updates (59a6271) by @dependabot[bot] in #133
- Build(deps): bump hydra-core from 1.4.0.dev1 to 1.4.0.dev10 (f9c8423) by @dependabot[bot] in #137
- Update changelog for version 0.1.0 (c94e59d) by @AndrejOrsula
- CI: Name jobs and group Dependabot updates (f9651e0) by @AndrejOrsula
- CI: Build and publish the Docker image with standard actions (6dab938) by @AndrejOrsula
- CI: Simplify workflows and publish via trusted publishing (721cbb8) by @AndrejOrsula
- CI: Use GitHub-hosted runners for all but the Docker workflow (c3d6976) by @AndrejOrsula
- Bump to 0.1.0 (773ef76) by @AndrejOrsula
- Update license year (1e4901c) by @AndrejOrsula
- Docs: Regenerate asset and task pages (a147f8e) by @AndrejOrsula
- Docs: Update sensor and misc pages (e702d49) by @AndrejOrsula
- Docs: Expand integration and workflow guides (802a7ab) by @AndrejOrsula
- Docs: Expand configuration and contributor guides (a0b420b) by @AndrejOrsula
- Docs: Update installation, usage, and robot pages (7cb0935) by @AndrejOrsula
- Update devcontainer, editor settings, and pre-commit hooks (24fabf4) by @AndrejOrsula
- Update Kit applications and rendering modes (52d813e) by @AndrejOrsula
- Update dependencies and require Python 3.12 (dd09ac4) by @AndrejOrsula
- CI: Update workflows and dependency automation (e1696d2) by @AndrejOrsula
- Docker: Update for Isaac Sim 6.1 and Isaac Lab 3.0 (d85e947) by @AndrejOrsula
- Update RL algorithm hyperparameters (c950b60) by @AndrejOrsula
- Update training and task hyperparameters (9ed355f) by @AndrejOrsula
- GUI: Update application shell and styling (81185b5) by @AndrejOrsula
- GUI: Harden runtime and process supervision (0b06e69) by @AndrejOrsula
- GUI: Refactor workflow and task selection (0521c8c) by @AndrejOrsula
- Update cargo-deny advisory ignores (4e9a3ac) by @AndrejOrsula
- CLI: Split simulated and real agent workflows (caea3cc) by @AndrejOrsula
- Require explicit registration of generated sim-to-real envs (b3a91f6) by @AndrejOrsula
- Update teleoperation device backends (4779004) by @AndrejOrsula
- Extract ROS and GUI environment interfaces (92a410c) by @AndrejOrsula
- Update shared mobile manipulation templates (5a3952d) by @AndrejOrsula
- Update mobile debris capture task (5d7c75b) by @AndrejOrsula
- Update shared aerial, ground, and orbital task templates (c0545d8) by @AndrejOrsula
- Update orbital evasion and rendezvous tasks (d5e7f27) by @AndrejOrsula
- Landing: Update task and event camera behavior (bca5ef9) by @AndrejOrsula
- Update waypoint and velocity tracking tasks (5b3d819) by @AndrejOrsula
- Update shared manipulation task template (35532ef) by @AndrejOrsula
- Update debris capture, screwdriving, and solar panel tasks (e785aa2) by @AndrejOrsula
- Rename peg_in_hole_assembly to peg_in_hole and update related tasks (529d1fd) by @AndrejOrsula
- Make task registration explicit and report import failures (4010820) by @AndrejOrsula
- Update assets (3214989) by @AndrejOrsula
- Move asset update script to assets/scripts (f947b4e) by @AndrejOrsula
- Reorganize robot asset families (9891a9d) by @AndrejOrsula
- Expand and reorganize object and tool assets (40dab20) by @AndrejOrsula
- Update simulation spawners, rendering modes, and particle state (442efc4) by @AndrejOrsula
- Refactor environment runtime and add active sensor selection (5f300cd) by @AndrejOrsula
- Update core asset types and robot models (ab5e47e) by @AndrejOrsula
Fixed
- Docker: Fix Hydra override completions (843c406) by @AndrejOrsula
- Fix egl-probe build with CMake 4 (7022ef8) by @AndrejOrsula
Removed
- Remove orbital_lunalab task and the modelling envelope intro sentence (d90bb4a) by @AndrejOrsula
- Remove Rust library and Python extension crates (17bc07b) by @AndrejOrsula
- Remove visual environment variants (8047a2d) by @AndrejOrsula