Proceedings of the 25th International Conference on Machine Learning - ICML '08 2008
DOI: 10.1145/1390156.1390200
|View full text |Cite
|
Sign up to set email alerts
|

Memory bounded inference in topic models

Abstract: What type of algorithms and statistical techniques support learning from very large datasets over long stretches of time? We address this question through a memory bounded version of a variational EM algorithm that approximates inference in a topic model. The algorithm alternates two phases: "model building" and "model compression" in order to always satisfy a given memory constraint. The model building phase expands its internal representation (the number of topics) as more data arrives through Bayesian model… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1

Citation Types

0
2
0

Year Published

2009
2009
2017
2017

Publication Types

Select...
2
2
2

Relationship

0
6

Authors

Journals

citations
Cited by 6 publications
(2 citation statements)
references
References 6 publications
0
2
0
Order By: Relevance
“…The efficiency of LDA can be improved with the use of heuristics, e.g., by running it on each neighborhood independently, decreasing the number of documents by having more tweets per document, and specifying a lower number of topics. Recent work has also explored multiple approaches for increasing the performance of LDA [35,57,65,73,88], which can be applied to POISED.…”
Section: Discussionmentioning
confidence: 99%
“…The efficiency of LDA can be improved with the use of heuristics, e.g., by running it on each neighborhood independently, decreasing the number of documents by having more tweets per document, and specifying a lower number of topics. Recent work has also explored multiple approaches for increasing the performance of LDA [35,57,65,73,88], which can be applied to POISED.…”
Section: Discussionmentioning
confidence: 99%
“…-Gomes, Welling and Perona [10] presented an enhancement of the VEM algorithm using a bounded amount of memory. -Porteous and et al [11] proposed a method to accelerate the computation of (Eq.1).…”
Section: Lda Performance Enhancementmentioning
confidence: 99%