Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MRPT ANN test occasionally fails #78

Open
rcurtin opened this issue Jun 30, 2017 · 0 comments
Open

MRPT ANN test occasionally fails #78

rcurtin opened this issue Jun 30, 2017 · 0 comments

Comments

@rcurtin
Copy link
Member

rcurtin commented Jun 30, 2017

I've noticed that sometimes, the ANN test for MRPT fails, but not always:

$ env # filtered for only the necessary stuff
LD_LIBRARY_PATH=libraries/lib/
VALGRIND_BIN=/usr/bin/valgrind
ANN_PATH=methods/ann/
FLANN_PATH=methods/flann/
MS_PRINT_BIN=/usr/bin/ms_print
MATLABPATH=/home/ryan/src/benchmarks-rc/methods/matlab
DEBUGBINPATH=libraries/mlpack/build-debug/bin/
PYTHONPATH=libraries/lib/python3.5/site-packages:libraries/lib/python3.5/dist-packages
JAVAPATH=libraries/share/
MATLAB_BIN=/opt/matlab/bin/
BINPATH=libraries/bin/
{ ryan@slake }{ ~/src/benchmarks-rc } $ python3.5 tests/benchmark_ann.py
.[INFO ] Perform Approximate Nearest Neighbours.
[INFO ] Loading dataset
..[INFO ] Perform Approximate Nearest Neighbours.
[INFO ] Loading dataset
E.[INFO ] Perform Approximate Nearest Neighbours.
[INFO ] Loading dataset
..[INFO ] Perform ANN.
[INFO ] Loading dataset
.
======================================================================
ERROR: test_RunMetrics (__main__.ANN_MRPT_TEST)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "tests/benchmark_ann.py", line 78, in test_RunMetrics
    self.assertTrue(result["Runtime"] > 0)
TypeError: 'int' object is not subscriptable

----------------------------------------------------------------------
Ran 8 tests in 8.966s

FAILED (errors=1)
{ ryan@slake }{ ~/src/benchmarks-rc } $ python3.5 tests/benchmark_ann.py
.[INFO ] Perform Approximate Nearest Neighbours.
[INFO ] Loading dataset
..[INFO ] Perform Approximate Nearest Neighbours.
[INFO ] Loading dataset
..[INFO ] Perform Approximate Nearest Neighbours.
[INFO ] Loading dataset
..[INFO ] Perform ANN.
[INFO ] Loading dataset
.
----------------------------------------------------------------------
Ran 8 tests in 6.116s

OK

@Iron-Stark: could you look into this one please? Maybe there is some issue with the implementation. We can see the issue is also happening on the benchmark nodes: http://masterblaster.mlpack.org/job/benchmark%20-%20checkout%20-%20all%20nodes/label=savannah/90/testReport/

All the information I gave above (the environment variables especially) should be helpful enough for you to reproduce the issue; let me know if I can help out with that.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant