Skip to content

IROS 2026 MrGrasp

hwoo.han edited this page Sep 7, 2026 · 1 revision

IROS 2026 β€” MrGrasp: Multi-Rate Vision–Tactile–Language–Action for Gentle Grasping of Fragile Deformables

Venue: IROS 2026 (Pittsburgh) Β· paper #2149 Β· Huazhong Univ. of S&T (Pei, Gao, Miao, Gao, Li). Representative of: deformable-object manipulation Γ— tactile-in-the-loop β€” a Vision–Tactile–Language–Action (VTLA) framework that grasps fragile deformable objects gently by running a fast tactile control loop under a slow VLM planner. Companions: Tactile VLA Β· Dexterous Manipulation Β· IROS 2026 survey.

1. Problem

Grasping fragile deformable objects is a hard contact-rich task: rapid deformation and shifting contact areas change contact state fast, and vision-only policies can't perceive/regulate contact β†’ instability or damage. Imitation learning helps but intra-category variation makes covering all instances with demos impractical (weak generalization).

2. Method

MrGrasp is a hierarchical multi-rate VTLA framework:

  • High-level VLM planner β€” a pretrained VLM turns semantic instruction + visual observation into domain-invariant task representations, decoupling low-level execution from appearance variability.
  • Diffusion multi-rate grasp policy β€” a low-rate branch produces motion-trajectory priors; a high-rate branch fine-tunes grasp control in a closed loop with real-time tactile feedback, handling fast-changing contact.

3. Results

  • Across diverse fragile deformables, MrGrasp beats vision-based baselines and stays robust under unseen instances and external perturbations β€” validating the multi-rate VTLA recipe for contact-rich fragile grasping.

4. Why it matters

MrGrasp represents two IROS 2026 gap-themes at once β€” deformable-object manipulation and tactile-in-the-loop control β€” via the now-recurring fast/slow multi-rate structure (cf. T-Rex's variable-rate MoT and Review-Realtime-Execution): a slow VLM sets intent, a fast tactile loop regulates contact. It's the fragile/deformable counterpart to T-Rex (both put touch in a high-rate reactive loop under a VLA), and evidence that tactile is becoming a first-class high-frequency channel in 2026 manipulation, not just an input.

Limitations (reviewer): grasping-scoped (not full manipulation); needs a tactile-equipped gripper; diffusion policy adds cost; evaluated on fragile-deformable grasping, not broad tasks.

5. Links

← Back to IROS 2026 survey Β· Home

Navigation

πŸ“– Reviews

🏷 Model lineages

🧠 ML foundations

πŸ—“ Conferences

(each page indexes its per-paper pages)

πŸ“Œ Foundational

Clone this wiki locally