Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about the paper #5

Closed
xiexie123 opened this issue Feb 7, 2024 · 3 comments
Closed

Questions about the paper #5

xiexie123 opened this issue Feb 7, 2024 · 3 comments

Comments

@xiexie123
Copy link

Thanks for your great work!

I am reading paper. In section 3.3 said " To recover the re�maining 2 DoFs, scale s and in-plane rotation α, we train deep networks to directly regress these values from a single 2D-2D correspondence. Since the feature extractor Fae is invariant to in-plane rotation and scaling, the corresponding features cannot be used to regress those values, hence we have to train another feature extractor we call Fist".

why? A simple Image regestring method based on SIFT descriptors, and SIFT descriptors is invariant to in-plane rotation and scaling.

@xiexie123
Copy link
Author

I see. You use feature to regress scale s and in-plane rotation α.
another question, why not use correspondences and RANSAC to get scale s and in-plane rotation α, translation t like a simple image regestring method based on SIFT descriptors, Since you have got the the correspondences from Fae ?

@nv-nguyen nv-nguyen changed the title Fae feature is invariant to in-plane rotation and scaling, cannot be used to regress ratation and scale? Questions about the paper Feb 7, 2024
@nv-nguyen
Copy link
Owner

nv-nguyen commented Feb 7, 2024

Thanks for your interest!

We show in Table 4 the ablation study with different ways to predict the scale, and in-plane rotation from multiple correspondences as you mentioned (n=2 or n=4). Our method predicts fully 6D pose from a single correspondence (n=1) which is different and outperforms other approaches.

@nv-nguyen
Copy link
Owner

I closed the issue but feel free to re-open it again if you have additional questions!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants