Improving Topic Coherence Using Entity Extraction Denoising

Abstract

Managing large collections of documents is an important problem for many areas of science, industry, and culture. Probabilistic topic modeling offers a promising solution. Topic modeling is an unsupervised machine learning method and the evaluation of this model is an interesting problem on its own. Topic interpretability measures have been developed in recent years as a more natural option for topic quality evaluation, emulating human perception of coherence with word sets correlation scores. In this paper, we show experimental evidence of the improvement of topic coherence score by restricting the training corpus to that of relevant information in the document obtained by Entity Recognition. We experiment with job advertisement data and find that with this approach topic models improve interpretability in about 40 percentage points on average. Our analysis reveals as well that using the extracted text chunks, some redundant topics are joined while others are split into more skill-specific topics. Fine-grained topics observed in models using the whole text are preserved.

What does the media tell us about a destination? The Cancun case, seen from the USA, Canada, and Mexico

“…Such quantification helps to discriminate between collections of terms semantically related and statistical noise. For a better understanding of the metric, we refer to (Cardenas et al , 2018; Huang, 2019).…”

A Micro Perspective of Research Dynamics Through “Citations of Citations” Topic Analysis

“…Though most topic models use bag-of-words representations, it is generally recognized that single words lack interpretability. Recent work by Cardenas et al (2018) also reports that an entity can improve topic coherence compared to bagof-words. In our work, we use entities that are provided by Semantic Scholar Open Corpus.…”