about left right eye landmarks question

[lilinxiong]

In all of the landmark connection vector found it FaceMesh_Map.jpg and Contour keypoints. The landmark for the left eye is: left eyes:
. The landmark for the right eye is: right eyes:

But in iris_tracking_gpu.pbtxt. define left eye boundary is (in L84-L96):

define right eye boundary is (in L98-L110):

In other words, the landmarks in pbtxt and the left and right eye landmarks defined by keypoints are inconsistent. Where is wrong?

[04633435]

Yes, I also noticed this inconsistency when I was trying to change the range of the eye_boundary_landmarks. Did you find the correct landmarks_indices mapping yet?

[lilinxiong]

@04633435 I think Contour keypoints is right, because it matches the mirror image we perceive. So currently in the graph, I adjust it according to it. I haven't waited for the official reply yet, I'm still waiting for the official explanation.

[04633435]

@04633435 I think Contour keypoints is right, because it matches the mirror image we perceive. So currently in the graph, I adjust it according to it. I haven't waited for the official reply yet, I'm still waiting for the official explanation.

Thank you for your reply!
I just look through the Contour keypoints, but there are only 229 points, half of the vertices excluding the iris landmarks. Seems like there are some points missing. Do you have any clue?

[lilinxiong]

@04633435 Face Mesh has a total of 468 points. iris is an extra 10 points(left 5, right 5). Not included in FaceMesh.
In iris_tracking_gpu.pbtxt ConcatenateNormalizedLandmarkListCalculator code can be found.
Note: left iris landmarks and right iris landmarks the order is different, you have to distinguish it yourself. I made changes in my app, so this part can’t be shared with you.

[04633435]

Hi, @lilinxiong, I solved my problem. And for the problem you mentioned above, in L84-L96, it selects out the inner corner and outer corner landmarks of the left eye, and within the subgraph iris_landmark_landmarks_to_roi.pbtxt of the iris_landmark module, these two landmarks are used to create a square boundary around the left eye area. So in L84-L96, there are only landmark 33 and 133, not the whole left eye contours landmarks.

[lilinxiong]

@04633435 I don’t think we are talking about the same issue.

Face Mesh has a total of 468 points. iris is an extra 10 points(left 5, right 5). ........

My answer here is that the iris coordinates are added to the content related to FaceMesh landmark.
Including the order of iris coordinates and the position added to FaceMesh.

And for the problem you mentioned above, in L84-L96, it selects out the inner corner and outer corner landmarks of the left eye.....

As for what you are answering now, I think you only need to exchange the subscript values of left and right in the original pbtxt.
The original intent of this issue is that the left and right in pbtxt are written inversely, so even after swapping left and right, the result is still the opposite. You can verify it yourself.
I'm not sure, whether you know what I want to express, but the final conclusion is: even after you swap left and right, their final value is unchanged, just changing here will not take effect. Other places need to be changed.

[kuaashish]

Hello @lilinxiong,
We are upgrading the MediaPipe Legacy Solutions to new MediaPipe solutions However, the libraries, documentation, and source code for all the MediaPipe Legacy Solutions will continue to be available in our GitHub repository and through library distribution services, such as Maven and NPM.

You can continue to use those legacy solutions in your applications if you choose. Though, we would request you to check new MediaPipe solutions which can help you more easily build and customize ML solutions for your applications. These new solutions will provide a superset of capabilities available in the legacy solutions.

[google-ml-butler]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you.

[github-actions]

This issue has been marked stale because it has no recent activity since 7 days. It will be closed if no further activity occurs. Thank you.

[github-actions]

This issue was closed due to lack of activity after being marked stale for past 7 days.