New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Search-tag on labels, resets prior annotation on text classification hand labeling with multi_label=True #1711
Comments
Thanks for reporting @dhruvsakalley We will take a look at this problem as soon as possible |
Thank you for the prompt response @frascuchon, similar behavior can be replicated while bulk annotating, it clears any prior annotations, now I wonder if the other controls respect the multi_label = True. |
Dear @dhruvsakalley , sorry for the late heads up. This should be fixed on Let us know if you find any issue. |
Hi, I can confirm the issue is partially fixed, the search tags, annotate, seem to work as expected, however the bulk annotation with "annotate as" still does overwrite prior labels in a similar fashion as the search and annotate was doing. My apologies if this is intended way of working, but it does seem like a related issue. I can open another issue on the topic if you could confirm this is a bug and not a feature. |
Yes, is the expected behavior. The bulk annotation will set the selected labels as the annotated ones. Effectively, in some cases, working with multi-label text classification, this partial bulk annotation could be useful. Let us discuss this internally to evaluate the feature @dvsrepo @davidberenstein1957 Again, thanks for your feedback! |
Thanks for confirming, |
It appears that the search function on labels in case of hand labeling - text classification with multiple labels clears all prior annotations on close. This creates a major bug, because it is not apparent immediately that the prior annotation labels have been reset since they are out of visible scope. The problems is even more pronounced if you are working with a large number of labels.
Steps to reproduce:
Create a
DatasetForTextClassification
with an array of records created usingAssign a large amount of labels to the dataset
Switch to the web app and try hand labeling, use the search on the labels (not the record) for toggling select, try a few search string and clear out search string after making selections, only the most recent labels maintain state, all prior label toggles get reset.
Appears to be a state management issue.
The text was updated successfully, but these errors were encountered: