You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
(I've used "annotation" and "label" interchangeably in this issue. Is there a difference and if so can we define the difference in the thread?)
We would like the community to be able to contribute annotations/labels for datasets on PhysioNet. These labels would capture details of interest about data such as images (e.g. chest x-rays) or waveforms (e.g. ECGs).
Some of the key challenges in doing this are:
defining what type of labels are of interest (i.e. what exactly are we asking people to label?).
making labels available for download and reuse in an simple-to-manage, simple-to-understand manner.
incentivising the community to contribute.
To help address these challenges, my suggestion is that we introduce a new "Annotation task" (or "Labeling task") project type, which would perhaps be most similar to the "Challenge" project type.
Someone interested in gathering labels would create a new project in the usual way, specifying:
Title: e.g. Labelling sinus vs non-sinus ECG rhythms.
Background: What is the background to the task? Why are labels needed?
Goal: What is the ultimate goal of the task?
Participation: Who should participate in the task, and how?
Data description: What is the data that is being labelled?
Evaluation (?): Will the quality of annotations be evaluated?
The project page would include clear instructions for providing annotations. It would probably include a link to one (or multiple) tools for doing the task. As annotations are submitted (and perhaps approved by the contributor), they will be archived in the "Files" section of the project.
The text was updated successfully, but these errors were encountered:
(I've used "annotation" and "label" interchangeably in this issue. Is there a difference and if so can we define the difference in the thread?)
We would like the community to be able to contribute annotations/labels for datasets on PhysioNet. These labels would capture details of interest about data such as images (e.g. chest x-rays) or waveforms (e.g. ECGs).
Some of the key challenges in doing this are:
To help address these challenges, my suggestion is that we introduce a new "Annotation task" (or "Labeling task") project type, which would perhaps be most similar to the "Challenge" project type.
Someone interested in gathering labels would create a new project in the usual way, specifying:
The project page would include clear instructions for providing annotations. It would probably include a link to one (or multiple) tools for doing the task. As annotations are submitted (and perhaps approved by the contributor), they will be archived in the "Files" section of the project.
The text was updated successfully, but these errors were encountered: