Stochastic Diffusion Model for Analysis of Dynamics and Forecasting Events in News Feeds

Abstract

One of the problems of forecasting events in news feeds, is the development of models which allow for work with semi structured information space of text documents. This article describes a model for forecasting events in news feeds, which is based on the use of stochastic dynamics of changes in the structure of non-stationary time series in news clusters (states of the information space) on the basis of use of diffusion approximation. Forecasting events in a news feed is based on their text description, vectorization, and finding the cosine value of the angle between the given vector and the centroids of various information space semantic clusters. Changes over time in the cosine value of such angles between the above vector and centroids can be represented as a point wandering on the [0, 1] segment. This segment contains a trap at the event occurrence threshold point, which the wandering point may eventually fall into. When creating the model, we have considered probability patterns of transitions between states in the information space. On the basis of this approach, we have derived a nonlinear second-order differential equation; formulated and solved the boundary value problem of forecasting news events, which allowed obtaining theoretical time dependence on the probability density function of the parameter distribution of non-stationary time series, which describe the information space evolution. The results of simulating the events instance probability dependence on time (with sets of parameter values of the developed model, which have been experimentally determined for already occurred events) show that the model is consistent and adequate (all the news events which have been used for the model verification occur with high values of probability (within the order of 80%), or if these are fictitious events, they can only occur over the course of inadmissible long time).

Підходи До Розв'язання Задачі Прогнозування Подій На Основі Новин

“…With the help of computational linguistics methods, it is necessary to carry out the following preliminary data processing: delete stop words, perform stemming or lematization and vectorization based on existing dictionaries, create a TF-IDF matrix. Then it is necessary to cluster by thematic groups with the date and time of the news [7]. The input data will be considered a vector representation of the textual description of predicted events, which allows you to find the cosine of the angle between the text and the centroids of thematic clusters derived from the news collection.…”