Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

some problem about the predict #44

Closed
jxncyym opened this issue May 24, 2022 · 9 comments
Closed

some problem about the predict #44

jxncyym opened this issue May 24, 2022 · 9 comments

Comments

@jxncyym
Copy link

jxncyym commented May 24, 2022

@erkil1452 hello, I'm sorry to trouble you again. I test my own trained model using the camera that comes with the laptop, the camera is on the top-midde of the labtop. when I sit in the front of my labtop , the position of the eyes are on the same height of the camera, I got the correct gaze vector. However, when I test my own trained model using the video from the website, the gaze vector is not correct, I don't know why? whether I should do some thing like normalization of the head? another similar question is : when the tester is not in front of the camera, maybe there are some angles between the camera and the eyes(for example, the camera is on the left side or right side of the tester, or the camera looks up at the face), how can I get the correct gaze vector? thankyou!

@liyixin-1
Copy link

@jxncyym I'm having the same problem as you, can you tell me about your reproduction process?

@erkil1452
Copy link
Owner

The predicted gaze vector should be [0,0,1] when you look into the camera. It should not matter where the camera is.

@jxncyym
Copy link
Author

jxncyym commented May 25, 2022

@erkil1452 then what should I do to make the gaze vector to be [0,0,1] when look into the camera, could you describle the procedure detail?
I found some describles in your paper
image

for the formula
image
I want to confirm something :
1.the gL is the gaze vector predicted by our model ? and image is the norm of gL?
2. then how to calculate the E when I predict the gaze using a video or a image capture with the camera within the labtop?

@erkil1452
Copy link
Owner

erkil1452 commented May 25, 2022

You misunderstood. The output of the neural network should already be [0,0,1] (or -1?). You do not need to do anything.

@jxncyym
Copy link
Author

jxncyym commented May 25, 2022

@erkil1452 as you said, why I can't get the correct gaze vector when I predict the gaze vector with a video? but I can get the correct result when I use the camera within the labtop, as I sit in front of the labtop,and the eyes have the same height with the camera? I can't understand and I don't know why?

@erkil1452
Copy link
Owner

So it works for you with images from a webcam? That is great! Then you just need to debug what is wrong with the video sequence. I am sure it must be some small error somewhere. Perhaps try to record video from your webcam to make the conditions as similar as possible.

@jxncyym
Copy link
Author

jxncyym commented May 25, 2022

ok, I will try it tomorrow, maybe there are still some question want to consult you

@jxncyym
Copy link
Author

jxncyym commented May 28, 2022

@erkil1452 I find the problem and solved it, thankyou

@erkil1452
Copy link
Owner

Glad to hear that!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants