Release Candidate January 2018

[mfehr]

Release Candidate January 2018

This branch currently requires a special dependencies branch:

maplab_dependencies/#162

Please note that this is a release candidate and needs further testing. If you would like to give it a try, please do so, but read the release notes carefully. This version does not yet conform to the descriptions, tutorials and reported performance in the wiki! We are happy for any feedback you can provide regarding the localization and map merging performance, as well as the compatibility with your ARM devices.

How to update

There is a new submodule in dependencies, please do the following:

cd ~/maplab_ws/src/maplab_dependencies
git submodule init
git submodule update

TODOs

• Add build server support for ARM
• Fix issues with precision for ARM unit tests
• Adapt wiki and the uploaded calibration/map data
• Test tutorials
• Investigate and fix slightly deteriorated performance of map alignment and merging.
• Finalize release and add release tag

Changes

• ROVIOLI - Localization using Structure Constraints:

  Previous Version:

  The localization, represented by T_G_M (the transformation from mission/odometry to global frame), was estimated by ROVIO as part of its state based on updates sent by the feature-based localization. These updates contained a 6-DoF global pose estimate (T_G_I) with a constant, hard-coded covariance.

  Update:

  This release introduces structure localization. ROVIO no longer receives localization updates as the 6-DoF global pose (T_G_I), but receives 2D-3D matches and updates the state using reprojection errors. These 2D-3D matches denote the correspondences between localization map landmarks and keypoints in the frame we are trying to localize. Assuming a constant, isotropic covariance of the localization landmark positions yields a better performance than assuming a constant covariance of the 6dof pose constraint. Furthermore we integrated a reset logic that resets the localization state when a large change is detected, i.e. when re-localizing after leaving the localization map for some time.

  Effects:

  • The localization performance increases significantly.
  • The mission/odometry frame (T_M_I) is now more stable and is not affected anymore by jumps in the localization. This is crucial for robot control, which is usually performed on the locally consistent, but more stable T_M_I rather than the globally consistent, but potentially discontinuous T_G_I.
  • Localization receives a proper covariance estimate, which improves the behavior in the presence of dubious localizations or drift of the estimator.

• ROVIOLI - Health checker:

  New Feature:

  ROVIOLI now comes with a health checker that monitors the current state of the odometry and if it detects a divergence, resets the state to what it assumes to be the last stable state. Currently the following health criterion are implemented:

  • feature distance covariance
  • velocity

  Since an unexpected VIO reset can cause considerable damage, e.g. on a flying platform, we disabled this feature by default. However, we highly recommend that you give it a try and enable it with:

  --rovioli_enable_health_checking

  Effects:

  • If enabled, ROVIOLI recovers within seconds after ROVIO diverges, e.g. because the camera is occluded for too long or the sensor suffered a shock.

• maplab/ROVIOLI - Rotation invariant descriptors

  Update:

  This feature was basically already there in the initial release, however by default it was always disabled, as the rotation invariance lead to a slightly lower overall descriptor matching performance if the camera orientation is static. However to make ROVIOLI applicable to the general use-case, e.g. down facing aerial cameras or end-effector cameras on robotic arms we now enabled this option by default. It can be switched on/off using the following flag:

  --rovioli_descriptor_rotation_invariance

  Effects:

  • The descriptors will not get matched across maps with different settings, therefore if you create a localization map, make sure the you use the same setting when localizing from this map. Since the option is now ON by default. Previously created localization maps might not work without switching off the rotation invariance in ROVIOLI.
  • The maplab console can be launched without considering this option, because the flag only takes effect when creating new descriptors.
  • The ROVIOLI flag will overwrite the value of this flag, so don't use it:
    --feature_tracking_descriptor_rotation_invariance.

• ROVIOLI - Unified maplab and rovio sigmas

  Previous version:

  Due to a difference in the convention of the IMU parameters, two separate IMU parameter files for ROVIO and maplab had to be passed to ROVIOLI.

  --imu_parameters_maplab=$IMU_PARAMETERS_MAPLAB
  --imu_parameters_rovio=$IMU_PARAMETERS_ROVIO

  Update:

  We unified the parameters and it now suffices to simply pass the maplab IMU parameters to ROVIOLI.

  Effects:

  • ROVIOLI can now be launched with just these IMU parameters:

    --imu_parameters_maplab=$IMU_PARAMETERS_MAPLAB

  • We observed a better performance in terms of drift in the VIO when using the maplab values.
  • If the performance deteriorates for your application and you prefer to have separate parameters for ROVIO and maplab, you can still pass in ROVIO sigmas using the following NEW flag:

    --external_imu_parameters_rovio=$IMU_PARAMETERS_ROVIO

    The ROVIO IMU parameters correspond to the covariance, the maplab parameters correspond to sigmas and therefore interally we simply pass the squared values of the maplab parameters to ROVIO. For the new ROVIO IMU parameters you need to take the square root of your previous ROVIO parameters.

• ROVIOLI - Intel Realsense ZR300 ROS publisher and parameters

  New feature:

  Even though the ZR300 has been discontinued, it is still one of the most capable, affordable and publicly available visual-inertial sensors. We therefore added a template calibration for camera and IMU to facilitate the integration of ROVIOLI on this sensor. The files can be found in maplab/applications/rovioli/share.

  Furthermore, to improve the support of this sensor on Ubuntu 14.04 and 16.04 we provide a dedicated ROS sensor node here: maplab_realsense

  We also re-organized the calibration files to correspond to the three sensor we provide calibration templates for, the ZR300, the Skybotix VI-sensor and the Google Tango Yellowstone tablet.

• ROVIOLI - Improve latency of pose estimation

  Previous version:

  The ROVIO filter update is triggered by the RovioInterface object. We have discovered that the update was triggered unnecessarily late, only after the next camera frame was feeded to ROVIO. For instance, for a framerate of 10Hz it resulted in an additional 100ms delay of the pose output. This behavior can lead to issues if someone wants to directly control an agile robot (e.g. an MAV) using the pose output of ROVIOLI.

  Update:

  The logic of updating the ROVIO filter has been changed and the updates are processed as soon as they leave the update queue. The filter is no longer waiting for the next image to start processing the previous updates.

  Effects:

  ROVIOLI pose estimates are published with a smaller latency. This is particularly important for real-time systems and control purposes.

• armv7 and armv8 build support

  This release adds compatibility with armv7 and armv8.

  If you run into any trouble, make sure you clean your workspace.

  catkin clean
  catkin build maplab
  

  We would welcome any feedback about compatibility with your ARM devices.

[ethzasl-jenkins]

Test FAILed.

[ethzasl-jenkins]

Test FAILed.

[ethzasl-jenkins]

Test FAILed.