Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Type 2 change framework #18

Merged
merged 6 commits into from
Jul 26, 2022
Merged

Type 2 change framework #18

merged 6 commits into from
Jul 26, 2022

Conversation

woodbe
Copy link
Contributor

@woodbe woodbe commented Jul 5, 2022

This is to close #17 and provide a framework for how to define the materials needed.

Publication for v2 (matched with v1.1 PPM)
This is to close #17 and provide a framework for how to define the materials needed.
Copy link
Collaborator

@n-kai n-kai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"Requirements for Tools" in [Face Toolbox Overview] states as follows. So we have to discuss and modify the following text first.

This toolbox defines two level of tools—​Type 1 and Type 2—​to cover variety of tools to conduct the PAD testing efficiently. Not all tools have both levels.

Type 1 tools are inexpensive and can be used by novices to capture and upload images to social media. An attacker may also create face artefacts with such uploaded images without difficulty. Detailed attack methods using uploaded images have been published on the Internet, so the evaluator shall try this type of artefact first.

Type 2 tools have better performance (e.g., higher resolution) than Type 1 tools. Such tools should be the latest available (i.e., released at least within one year from the date of PAD testing, or as recent as possible depending on the type of device). Those tools may be expensive, but can be rented at an affordable cost. The reason why such tools should be used is that the PAD algorithm may show good rejection performance for artefacts used to train the algorithm, but reduced rejection performance for artefacts the algorithm has never seen before. Attackers may additionally create high-quality artifacts to maximize the chance of successful attacks.

@woodbe
Copy link
Contributor Author

woodbe commented Jul 11, 2022

@n-kai I have tried to make a modification that I think will do what we need, using recentness as strictly an example of what it could mean, along with "industry recognized" leading device. This should be broad enough but also set some goals.

@gregott can you look at the changes I made in the table and fill those in? I have some XXXXX marks where I had no idea what to put in terms of DPI/resolution, and I'm not even sure if that is the right way to look at it, so it may be that those are just wrong and should be replaced completely.

@woodbe
Copy link
Contributor Author

woodbe commented Jul 12, 2022

@woodbe to add in camera info from @gregott and update printer to "dedicated photo printer". Still need to work on display screen info.

@woodbe
Copy link
Contributor Author

woodbe commented Jul 12, 2022

So I just realized that the printer description is actually for Type 1, not Type 2, which is specifically to be professional services. Should we add a dedicated photo printer to type 2 and just adjust the type 1 to not be too old but can still be an AIO?

@gregott
Copy link
Collaborator

gregott commented Jul 12, 2022

I would leave Type 2 as professional services as long as those professional labs are in the class of WHCC or White Wall and not Walmart or Shutterfly.

As for the Type 1 printer specs, a dedicated photo printer with a minimum resolution of 2400 x 1200 dpi would be good. I am thinking of printers similar to Canon Pixma Pro-1000, Canon imagePROGRAF PRO-1000, Epson Expression Photo HD XP-15000, Epson SureColor P700 Inkjet Printer, etc. These are low end professional or high end enthusiast grade printers. Further, I would recommend the use of OEM pigmented inks when printing the PAIs.

Initial set of updates for camera, lens and printer from @gregott
@gregott
Copy link
Collaborator

gregott commented Jul 22, 2022

Here is what I would recommend for M2 Screen, Type 2:

  • Use a UHD (4K) or higher resolution display (TV or computer monitor)
  • Do not use TN (Twisted Nematic) displays
  • Do not use strobed backlight displays
  • Recommend IPS (In-Plane-Switching) or OLED displays

Some recommendations for displaying the PAI to the TOE:

  • Adjust camera to screen distance to minimize moiré patterns
  • Adjust camera and screen orientations to minimize reflections seen by the camera

I am not sure what is meant by “Test user’s face shall be displayed or replayed on the screen in full scale.” In fingerprint attacks, having a life size PAI is rather important. In situations where the biometric is being collected by a video camera, the TOE will scale as needed, within limits. So, I am not sure this is needed here. Generally, you want to fill the screen to the greatest extent possible if displaying on a mobile device. On a TV or large enough computer monitor you may want to try to get the face to be close to life size. That would allow the PAI to be roughly the same distance from the TOE as a real face would be, and that may not be a bad thing. All of this may depend on the PAD technique. If it needs to see some of the background behind the user then the size of the face relative to the display may change.

Added the moiré patterns to the overview as that had the general presentation instructions.
@woodbe woodbe requested a review from n-kai July 22, 2022 20:17
@woodbe
Copy link
Contributor Author

woodbe commented Jul 22, 2022

@gregott I have updated with this information. I put the moiré patterns into the overview document with the screen presentation info (reflection stuff already there).

@n-kai
Copy link
Collaborator

n-kai commented Jul 26, 2022

@gregott

I am not sure what is meant by “Test user’s face shall be displayed or replayed on the screen in full scale.”

My initial version simply said that M.2 Type 1 (Mobile device screen) should include user's full face.

I fully agree with you and “Test user’s face shall be displayed or replayed on the screen in full scale” in M.2 Type 1 should be replaced with “Screen shall include test user's full face and this face image shall be taken by the test user where the user holds the mobile device like normal face verification"

Copy link
Collaborator

@n-kai n-kai left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

L128 in the PR should be replaced with “Screen shall include test user's full face and this face image shall be taken by the test user where the user holds the mobile device like normal face verification" as I commented.

updated based on @n-kai comment
@woodbe
Copy link
Contributor Author

woodbe commented Jul 26, 2022

@n-kai I have made the update to line 128 and committed it into this change.

@woodbe woodbe merged commit 13db44e into Working Jul 26, 2022
@woodbe woodbe deleted the type2 branch July 26, 2022 14:47
@woodbe
Copy link
Contributor Author

woodbe commented Jul 26, 2022

Merged based on 7/26 call

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants