Task 1: Inconsistnecies between durationUsedToJudgeMs and judgedAtUnixTS #72
-
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Hi, |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
Hi, |
Beta Was this translation helpful? Give feedback.
Hi,
as far as I am aware durationUsedToJudgeMs is measured on the client, and the unix timestamp on the server. Fira uses asynchronous (potentially delayed) uploads, this definitely introduces some inconsistencies. To be honest we never looked at that connection before. For the published data we also capped the durationUsedToJudgeMs at 3 minutes or so to prevent large outliers (because if the annotator left the browser window open for a while and then came back to it, the duration naturally would be larger). If you want to look at the duration per judgment, I would only look at durationUsedToJudgeMs. And the unix timestamp could be used for time of day analysis, or to determine sessions.
…