XARP is a Python toolkit for extended reality. It replaces lengthy build-deploy cycles with a fast prototype workflow, think Streamlit or Gradio for XR. XARP also augments AI agents with XR capabilities at runtime through callable tools and a Model Context Protocol.
 |
 |
|---|---|
| Hand Gestures | GLB Models |
 |
 |
| Video Player | Depth Images |
 |
 |
|---|---|
| Learning with Spatial Metaphors (Team 1) | Disambiguating Object Selection (Team 2) |
 |
 |
| Dart Training Analytics (Team 6) | Multimodal Tutorial (Team 8) |
Install the XARP client on your device:
# library only
pip install git+https://github.com/HAL-UCSB/xarp.git
# agents and MCP
pip install git+https://github.com/HAL-UCSB/xarp.git --extra agents @article{caetano2025xarp,
title={XARP Tools: An Extended Reality Platform for Humans and AI Agents},
author={Caetano, Arthur and Kumaran, Radha and Jou, Kelvin and H{\"o}llerer, Tobias and Sra, Misha},
journal={arXiv preprint arXiv:2508.04108},
year={2025}
}