-
Notifications
You must be signed in to change notification settings - Fork 0
IROS 2026 MrGrasp
IROS 2026 β MrGrasp: Multi-Rate VisionβTactileβLanguageβAction for Gentle Grasping of Fragile Deformables
Venue: IROS 2026 (Pittsburgh) Β· paper #2149 Β· Huazhong Univ. of S&T (Pei, Gao, Miao, Gao, Li). Representative of: deformable-object manipulation Γ tactile-in-the-loop β a VisionβTactileβLanguageβAction (VTLA) framework that grasps fragile deformable objects gently by running a fast tactile control loop under a slow VLM planner. Companions: Tactile VLA Β· Dexterous Manipulation Β· IROS 2026 survey.
Grasping fragile deformable objects is a hard contact-rich task: rapid deformation and shifting contact areas change contact state fast, and vision-only policies can't perceive/regulate contact β instability or damage. Imitation learning helps but intra-category variation makes covering all instances with demos impractical (weak generalization).
MrGrasp is a hierarchical multi-rate VTLA framework:
- High-level VLM planner β a pretrained VLM turns semantic instruction + visual observation into domain-invariant task representations, decoupling low-level execution from appearance variability.
- Diffusion multi-rate grasp policy β a low-rate branch produces motion-trajectory priors; a high-rate branch fine-tunes grasp control in a closed loop with real-time tactile feedback, handling fast-changing contact.
- Across diverse fragile deformables, MrGrasp beats vision-based baselines and stays robust under unseen instances and external perturbations β validating the multi-rate VTLA recipe for contact-rich fragile grasping.
MrGrasp represents two IROS 2026 gap-themes at once β deformable-object manipulation and tactile-in-the-loop control β via the now-recurring fast/slow multi-rate structure (cf. T-Rex's variable-rate MoT and Review-Realtime-Execution): a slow VLM sets intent, a fast tactile loop regulates contact. It's the fragile/deformable counterpart to T-Rex (both put touch in a high-rate reactive loop under a VLA), and evidence that tactile is becoming a first-class high-frequency channel in 2026 manipulation, not just an input.
Limitations (reviewer): grasping-scoped (not full manipulation); needs a tactile-equipped gripper; diffusion policy adds cost; evaluated on fragile-deformable grasping, not broad tasks.
- Official program: IROS 2026 (paper #2149) Β· survey: IROS 2026
- Related: Tactile VLA Β· T-Rex Β· Real-Time Execution Β· Dexterous Manipulation
β Back to IROS 2026 survey Β· Home
- Home
- π Changelog
- πΈοΈ Knowledge Graph
- π Latest Papers
- All in-depth reviews β topic catalog Β· per-paper
- VLA Architectures
- RL for VLA
- World Models
- Dexterous Manipulation
- Cross-Embodiment
- Humanoid VLA
(each page indexes its per-paper pages)