Motus + RoboTwin + white-box input attack (noise / patch) for robotic VLA policies.
wam_attack/
├── Motus/ # Motus VLA model & training code
│ └── RoboTwin/ # RoboTwin simulation & evaluation
├── attacks/
│ ├── motus/ # Motus-specific attack train/eval scripts
│ └── fastwam/common/ # Shared noise/patch utilities
-
Clone this repo and create conda env (see
Motus/requirements.txt, RoboTwin docs). -
Download pretrained models into
Motus/pretrained_models/:Motus_robotwin2Wan2.2-TI2V-5BQwen3-VL-2B-Instruct
-
Download RoboTwin assets (see
Motus/RoboTwin/assets/_download.py). -
Edit
Motus/RoboTwin/policy/Motus/paths_config.ymlwith your local paths.
conda activate robotwin
cd Motus/RoboTwin
# White-box noise training
GPU_ID=7 bash ../../attacks/motus/train.sh
# White-box patch training
GPU_ID=7 bash ../../attacks/motus/train_patch.sh
# Attack evaluation
GPU_ID=7 TASK_NAME=click_alarmclock bash ../../attacks/motus/eval.sh
# Clean baseline
bash policy/Motus/eval.sh- Large weights, datasets, eval videos, and trained attack artifacts are not included in git.
- Patch/noise training optimizes universal perturbations against Motus action deviation (see
attacks/motus/whitebox.py).