Towards Automatic Detection and Tracking of Topic Change

Abstract

Abstract. We present an approach for automatic detection of topic change. Our approach is based on the analysis of statistical features of topics in time-sliced corpora and their dynamics over time. Processing large amounts of time-annotated news text, we identify new facets regarding a stream of topics consisting of latest news of public interest. Adaptable as an addition to the well known task of topic detection and tracking we aim to boil down a daily news stream to its novelty. For that we examine the contextual shift of the concepts over time slices. To quantify the amount of change, we adopt the volatility measure from econometrics and propose a new algorithm for frequency-independent detection of topic drift and change of meaning. The proposed measure does not rely on plain word frequency but the mixture of the co-occurrences of words. So, the analysis is highly independent of the absolute word frequencies and works over the whole frequency spectrum, especially also well for low-frequent words. Aggregating the computed time-related data of the terms allows to build overview illustrations of the most evolving terms for a whole time span.

Building Hierarchical Keyword Level Association Link Networks for Web Events Semantic Analysis

“…The basic metrics of the complex network are introduced in [1]. In [5], the keywords and the co-occurrence of them are considered together, but it does not introduce the complex network. Yang [15] tries to model the event evolution relationships between events in an incident.…”

Good location, terrible food: detecting feature sentiment in user-generated reviews

“…A number of researchers have applied natural language processing (NLP) techniques to detect features in small chunks of text (Nadeau and Sekine 2007;Holz and Teresniak 2010;Missen et al 2012). Hatzivassiloglou and McKeown (1997) use textual conjunctions to separate words with similar or opposite sentiment.…”

Interaktive explorative Suche in großen Dokumentbeständen

“…Um die für die Volatilitätsberechnung notwendigen globalen Kontexte zu ermitteln, wurden alle statistisch signifikanten Kookkurrenzen für alle knapp 7.500 Zeitscheiben berechnet, was zu annähernd 30 Milliarden gewichteten Wortpaaren führte. Details der Berechnung stehen nicht im Fokus dieses Artikels und können in [8] nachgelesen werden. Für Stoppwörter und seltene Wörter wurden keine Kookkurrenzdaten ermittelt.…”