Topic Modeling for Short Texts with Co-occurrence Frequency-Based Expansion

A Detailed Survey on Topic Modeling for Document and Short Text Data

“…For three authors, you may have to improvise. Frequency of Cooccurrence Words 7 [5], [27], [31][32][33][34][35][36] Pseudo documents 6 [22], [23], [36][37][38][39] Word weighting 6 [26], [40][41][42][43][44] Word Embedding 15 [31], [22], [26], [28][ [45][46][47][48][49][50][51][52][53][54][55][56] Sentence Level 1 [57] Hash tags 5 [23], [43], [46], [58], [59]…”

“…Co-occurrence of words is a common strategy used for retrieving topics from the corpus. Pedrosa et al, [36] proposed a novel method to develop pseudo-document structure by aggregating the cooccurring frequency of words which are well-organized in the corpus.…”

“…Google News - [22], [66], [80] Snippets 8 [8], [29], [36], [44], [45], [49][50][51][52], [68], [74], [75] NIPS - [38] DBLP 6 [31], [37], [62] Yahoo! Answers 11 [38], [45], [77], [82] Online News 7 [26][27][28][29], [31], [32], [37], [47], [62], [68], [81] Baidu Q & A 35 [49], [52], [37], [81][35] [15], [39], [75] Satck Overflow Q & A - [29], [44], [47] Tweets {August to Oct 2008}…”

“…[15], [19], [22], [23], [27] , [32], [35], [44][45][46], [51], [60][66], [67], [72], [73], [75], [80], [82], [83] Open Directory Project (ODP) - [37] Tweets related to Apple, Google, Microsoft, Twitter - [36], [70] Weibo Collections - [15], [35] Amazon Reviews (May 1994 -June 2014 contains product reviews) -7 [41] [45]…”

Machine Translation With Weakly Paired Documents

“…b) Leveraging topic alignment as regularization. Many previous works suggest that the word distribution can be usecd to well characterize the topic of the document (Petterson et al, 2010;Du et al, 2015;Funatsu et al, 2014;Pedrosa et al, 2016;Chemudugunta et al, 2007). To leverage the topic consistency between weakly paired documents, we minimize the KL-divergence of the word distributions between the ground-truth document and the model-generated document.…”