AdvancedExecutionProcedures

Execution Mode

The application starts in the competition mode if the the executionMode of InteractiveCleanupConfig.json is 0, it starts in the data generation mode if it is 1.

In the mode for the competition, the pre-generated EnvironmentInfoXX.json file is used to relocate objects and AvatarMotionXX.dat is used to reproduce the movements of the human avatar. In this case, if these files are not found, an error will occur.

In the data generation mode, need to prepare the VR headset(Oculus Quest 2). The position and orientation of relocatable objects is determined randomly upon execution, and the graspable objects are determined by the objects pointed by the human avatar. Then EnvironmentInfoXX.json and AvatarMotionXX.dat will be output.

Generate the Competition Data Using Oculus Quest 2

Generating competition data using Oculus Quest 2 is described below.
Competition data means EnvironmentInfoXX.json and AvatarMotionXX.dat.

1. Enable "Virtual Reality Supported"
   1. Click [Edit]-[Project Settings]-[Player] in Unity.
   2. Click [XR Settings] of PlayerSettings on Inspector.
   3. Check [Virtual Reality Supported] box.
2. Start the ROS side program.
3. Set the executionMode of InteractiveCleanupConfig.json to 1 and start the program.
4. Proceed as usual until receiving "I_am_ready" message.
5. Perform the pointing action using Oculus Touch Controller as follows:
   1. Press the A button or the X button. (Start recording the avatar motion)
   2. Press the middle finger trigger to display a laser pointer.
   3. Select the grasping target with the laser pointer and press the index finger trigger.
   4. Select the destination with the laser pointer and press the index finger trigger.
   5. Move back to initial position if you moved. (This is for re-pointing)
   6. Press the A button or X button. (recording end of avatar motion)

Although the competition data is output in the above procedure, it is possible to continue the ROS program to perform the cleanup task.
In this way, it is possible to verify in real time how the robot moves according to the movement of the person who is pointing.

Resuming the Challenge from the Next Task After Ending a Task Before Completion

This section describes how to resume the challenge from the next task if the previous task is ended before completion for some reason.

If isScoreFileUsed is true in InteractiveCleanupConfig.json, the file already including scores can be used to start the next task in the challenge.

Playback of Robot Movements During the Challenge

This section describes how to playback the robot's movements during the challenge so that you can check them later. Be aware this playback cannot fully reproduce collisions and changes to scores.

If you run the app with playbackType set to 1 in InteractiveCleanupConfig.json, the robot's movements during the challenge will be exported to PlaybackXX.dat. After that, set the playbackType to 2 and then run the app to read and play the robot's movements from Playback00.dat.

Note the number for the file to read is “00” for playback. You need to change the file name number to "00". Only one file can be used for playback each time.