Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evalutation Scripts, RMSE 0% on all sequences, trajectory file consists only of small number of frames #39

Open
ashishkumar822 opened this issue Jun 13, 2022 · 1 comment

Comments

@ashishkumar822
Copy link

ashishkumar822 commented Jun 13, 2022

Hi, I have two issues with the code base.

  1. I have got to compare accuracy of ICE-BA with some different front-end. But I could not find any evaluation script for computing ATE.
  2. I went through the code and found that back-end consists of RMSE calculations. However when I run it, I always get zero LBA and GBA error.

I get the following output:

../bin/back_end ../config/config_of_stereo.txt
Loaded '../config/config_of_stereo.txt'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/mav0/cam0/data/1403637010601666560.png'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/dat/1403637010601666560.png.dat'
Found '/home/isl-server/vo_seqs/vo_sequences/MH02/mav0/cam1/data/1403637010601666560.png'
Loaded '/home/isl-server/vo_seqs/vo_sequences/MH02/./calibration.dat'
Tcu = 0.014865 0.999557 -0.025774 0.065223
-0.999881 0.014967 0.003756 -0.020706
0.004140 0.025716 0.999661 -0.008055
Tlr = 0.999997 -0.002317 -0.000343 0.110074
0.002312 0.999898 -0.014091 -0.000157
0.000376 0.014090 0.999901 0.000889
K = 458.653992 457.295990 367.214996 248.375000
d = -0.283408 0.073959 0.000194 0.000018 0.000000 0.000000 0.000000 0.000000
Kr = 457.587006 456.134003 379.998993 255.238007
dr = -0.283684 0.074513 -0.000105 -0.000036 0.000000 0.000000 0.000000 0.000000
Loaded '../config/config_of_stereo.txt'
3040 / 3040 = 100.000000%

RMSE
LBA = 0.000000 / 73.761749 = 0.000000%
GBA = 0.000000 / 73.761749 = 0.000000%
Saved '/home/isl-server/vo_seqs/vo_sequences/MH02/../RMSE_stereo/MH02_1.txt'

Time
LBA = 7206.813965 / 3040 = 2.370662 ms
GBA = 2642.825439 / 315 = 8.389922 ms

Kindly provide solution as soon as possible as we need to meet a near deadline.

Thank you

@yrq0208
Copy link

yrq0208 commented Aug 10, 2022

Hi @ashishkumar822 ,
if it is not too late already, you can try using evo https://github.com/MichaelGrupp/evo for the calculation of RMSE

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants