testOxfordDataset.sh fails with "BAD" descriptors, keypoints, and features

[andrew-hardin]

I'm hunting for a GPU accelerated version of SIFT that's comparable to existing CPU options. I'm looking at popsift because it's marketed as creating similar features to OpenCV or VLFeat. After building develop, I ran make prepare-test and make run-test. A snippet of the output is included below:

pyramid compare: /volatile/popsift-test2/build/reference/ubc/output-img2/dir-octave/pyramid-o-7-l-4.pgm and pyramid-o-7-l-4.pgm differ
...
DoG compare: /volatile/popsift-test2/build/reference/ubc/output-img2/dir-dog/d-pyramid-o-0-l-0.pgm and d-pyramid-o-0-l-0.pgm differ
...
Keypoints BAD. Descriptors BAD. 
Compare leuven img6 with reference. Features BAD. 
cmp /redacted/build/reference/leuven/output-img6/features.txt /redacted/build/oxford/leuven/output-img6/features.txt

I visually compared two PGM files and verified that they do appear slightly different:

Environment and build details:

• CUDA: 10.2
• Driver: 440.64.00
• Device: GeForce RTX 2070
• Config: Release
• Commit: '3e624d'

Should I expect these tests to pass? Or, are slight variations expected?

[simogasp]

Not that it matters, but are u using the develop or your branch from the PR of removing boost? (just to know how to reproduce etc)

We should ask @griwodz , I remember that at some point there was a bug with the pgm library but it think it should have been solved.

[andrew-hardin]

I was testing the Release configuration on develop with no modifications (commit 3e624d).

[tkircher]

I have the exact same configuration, but commit f63d305. Same issue, bad descriptors.