Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

f1-score evaluation #9

Open
p16i opened this issue Oct 25, 2018 · 0 comments
Open

f1-score evaluation #9

p16i opened this issue Oct 25, 2018 · 0 comments

Comments

@p16i
Copy link

p16i commented Oct 25, 2018

Hi,

While working on #8, it seems to me that the evaluation of f-score is based on flatten true and pred labels. For example, given 2 samples whose lengths are 7 and 20. The current code flatten the labels to shape (27,) and compute the score. However, I think it could overestimate the value.

To illustrate, I've made a notebook using random data. You can see in there that the avg f-score is slightly lower than the f-score from the flatten data.

Looking forward to your thought on this.

@p16i p16i changed the title Issues in evaluation Issue in f1-score evaluation Oct 25, 2018
@p16i p16i changed the title Issue in f1-score evaluation f1-score evaluation Oct 25, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant