Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow curation only after all annotators to who a document was assigned marked it as complete #135

Open
reckart opened this issue Oct 5, 2015 · 2 comments

Comments

@reckart
Copy link
Member

reckart commented Oct 5, 2015

Allow curation only after all annotations to who a document was assigned marked it as complete - not after the first person has marked it as complete. This is to avoid early curation / necessity for re-merges.

Or at least display a warning... or make it an option that needs to be explicitly enabled in the project settings to "allow curation of incompletely annotated document sets".

That would also kind of entail that it should not be possible to assign new annotators to a document if curation on that document has already started (or at least display a warning...)

@reckart reckart changed the title Allow curation only after all annotations to who a document was assigned marked it as complete Allow curation only after all annotators to who a document was assigned marked it as complete Mar 28, 2016
@reckart reckart added this to the 3.1.0 milestone Apr 4, 2016
@reckart reckart modified the milestones: 3.2.0, 3.3.0 Mar 20, 2017
@nkrot
Copy link

nkrot commented Apr 24, 2017

In my opinion, early curation is a realistic use case. Imagine annotators being on vacation while the project must be finished. As a project manager I would like to directly jump to the curation of the documents.

Upon entering curation phase, a document in question must be immediately locked for all users, regardless of whether the document has been annotated partially or not annotated at all.

@reckart
Copy link
Member Author

reckart commented Apr 24, 2017

Sounds reasonable. A confirmation dialog would be necessary in order to avoid documents being transitioned to the curation phase accidentally, e.g. something like "Only X of Y annotators have completed their annotations on this document. Starting curation now will make it impossible for the remaining Z annotators to perform their annotations. Are you sure you want to start curation?"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants