Skip to content
/ arcor2 Public

Solution for end-user programming of (collaborative) robots using Augmented Reality. From AR to Python and back!

License

Notifications You must be signed in to change notification settings

robofit/arcor2

Repository files navigation

ARCOR2

ARCOR stands for Augmented Reality Collaborative Robot. It is a system for simplified programming of collaborative robots based on augmented reality developed by Robo@FIT.

This repository contains the backend solution. It can be easily tested out or deployed using docker images. Unity-based client application for ARCore-supported tablets is available here.

Initial development was supported by Test-it-off: Robotic offline product testing project (Ministry of Industry and Trade of the Czech Republic).

For more technical and development-related information, please see our wiki.

Videos

To get an idea of what our research is about, take a look at a video that was created in collaboration with ABB:

Augmented Reality in Robot Programming: ABB YuMi showcase

The video presenting the ARCOR2 system and its development in detail:

ARCOR2: Framework for Collaborative End-User Management of Industrial Robotic Workplaces using AR

The following video by Kinali shows the use case (offline PCB testing), where the system was applied:

Test-it-off: robotic system for automatic products inspection

Usage

Most users will stick to Docker images. The easiest method how to get started, is to run fit-demo compose file, which (by default) does not need any hardware. You can just connect using a tablet with AREditor and play around. Alternatively, all packages are also published on PyPI, which might be helpful for advanced use cases. For information about changes, please see individual changelogs, or the Releases page.

Publications

  • Kapinus, Michal, et al. "Spatially situated end-user robot programming in augmented reality." 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE, 2019.
  • Kapinus, Michal, et al. "Improved Indirect Virtual Objects Selection Methods for Cluttered Augmented Reality Environments on Mobile Devices." Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction. 2022.
  • Bambušek, Daniel, et al. "Handheld Augmented Reality: Overcoming Reachability Limitations by Enabling Temporal Switching to Virtual Reality." Proceedings of the 2022 ACM/IEEE International Conference on Human-Robot Interaction. 2022.
  • Bambušek, Daniel, et al. How Do I Get There? Overcoming Reachability Limitations of Constrained Industrial Environments in Augmented Reality Applications. In: 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, 2023. p. 115-122.
  • Kapinus, Michal, et al. ARCOR2: Framework for Collaborative End-User Management of Industrial Robotic Workplaces using Augmented Reality. arXiv preprint arXiv:2306.08464, 2023.