New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Raw data exporter: Add option to not export low confidence values #2210
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The export functionality works as expected. However, I think the user should have to 'opt in' to filter out low-confidence data. My reasons are as follows:
- A lot of existing users are familiar with the raw export containing low-confidence data
- By defaulting to filter out low-confidence data, we might need to revise tutorials that filter blinks, or at least clarify for the user in each tutorial which option they should have toggled
- Filtering low-confidence data means there are missing samples in the export. This might lead to confusion for users who are calculating, e.g. eye rotation velocity using the intersample duration, or just when investigating sampling rates in general
|
3a. Indeed, users should not calculate eye rotation velocity using low-confidence data points |
Co-authored-by: Neil M. Thomas <neil87@mail.com>
3b. Agreed! |
Good points, |
Pupil Core software assigns "confidence" values to its pupil detections and gaze estimations. They indicate the quality of the measurement. Until now, the raw data exporter plugin exported all data, independently of its confidence. New users are often not aware of this and wonder why the exported data looks noisier than what they have seen in Pupil Player.
For visualization, Pupil Player hides gaze data below the "Minimum data confidence" threshold (adjustable in the general settings menu). Often, we recommend users to filter their data by a confidence threshold after exporting.
Starting with this PR, users will have the option to only including data above the "Minimum data confidence" threshold in the export. The option can be enabled in the raw data exporter's menu.
(credits to @N-M-T for raising awareness of this issue)