Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluation baseline. #141

Closed
abhijithneilabraham opened this issue Jun 11, 2021 · 2 comments
Closed

Evaluation baseline. #141

abhijithneilabraham opened this issue Jun 11, 2021 · 2 comments

Comments

@abhijithneilabraham
Copy link

Hi,

Please let me know where to find the evaluation data that you compared with your work against LDA.

Thank you.

@MaartenGr
Copy link
Owner

Evaluation is a difficult and, to a certain extent, subjective topic in topic modeling. Although methods exist such as c_v and c_npmi, they are merely proxies for a topic model's performance. They are by no means a ground truth and can have significant issues (e.g., sensitive to the number of words in a topic). So whether you find a low or high score, I would advise you to look at the topics yourself and see if they make sense to you.

Having said that, there is currently no evaluation procedure using these methods as I am trying to research the correct methods for evaluating this method (including DTM). However, you are free to experiment with some evaluation measures that are mentioned in #90.

@abhijithneilabraham
Copy link
Author

Thanks.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants