Embodied Attention

This module wraps two models from Maastricht University:

• the deep saliency model developed by Alexander Kroner
• the target selection model implemented by Mario Senden.

Additionally, another rosnode is provided to perform eye movements and save object to memory, when compiled with holographic. The integration in ROS has the advantage that the model can be run on a physical robot, such as a pan-tilt unit.

Dependencies

• tensorflow
• scikit-image

Installing

If you use the Neurorobotics, this module installs itself with the install script provided in CDP4 experiment.

Python standalone

You can install the provided python package attention to use the models in your python script the following way.

cd attention
pip install -e .

On the Neurorobotics Platform

To use this module on the Neurorobotics Platform, simply add it to your GazeboRosPackages/src/ folder. You can then copy the launchfile nrp.launch to your experiment folder and reference it in your .exc - see the CDP4 experiment for an example.

As a rosnode

You can use the following launcher to test the model with your webcam using ROS:

roslaunch embodied_attention webcam.launch

Have a look to attention/examples/saccade_static_image.py for an example script on how to use the saliency and saccade modules.