Coherence of Descriptors

[amritbhanu]

An Analysis of the Coherence of Descriptors in Topic Modeling

[bibtex](@Article{o2015analysis,
title={An analysis of the coherence of descriptors in topic modeling},
author={O’Callaghan, Derek and Greene, Derek and Carthy, Joe and Cunningham, P{'a}draig},
journal={Expert Systems with Applications},
volume={42},
number={13},
pages={5645--5657},
year={2015},
publisher={Elsevier}
})

General:

• Nothing New from the Machine Reading Tea Leaves #10. Just couple of variations using PMI

Measurea:

• perplexity or held-out likelihood
• distributional semantics measure based on an algorithm provided by the increasingly popular word2vec tool. Each term was represented as a vector in a semantic space, with topic coherence calculated as mean pairwise vector similarity; Cosine similarity, Jaccard similarity, and the Dice coefficient were used.
• Pointwise Mutual Information (PMI)