How to make a machine learn continuously: a tutorial of the Bayesian approach

Than, Khoat; Bui, Xuan; Nguyen-Trong, Tung; Truong, Khang; Nguyen, Son; Tran, Bach Xuan; Linh, Ngo Van; Nguyen-Duc, Anh

doi:10.1117/12.2518860

Search citation statements

Order By: Relevance

Paper Sections

Select...

Case Study 1: Application To Text Analysis1

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2020

Publication Types

Select...

Article1

Relationship

Self Cite1

Independent0

Authors

Journals

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…then we can design upper and lower bounds of the objective function f (θ) and we can apply BOPE algorithm for solving well the problem (6). We further show in this section the simplicity of using BOPE for designing fast learning algorithm for LDA.…”

Section: Case Study 1: Application To Text Analysismentioning

confidence: 92%

MAP Estimation With Bernoulli Randomness, and Its Application to Text Analysis and Recommender Systems

Bui

Nguyen

et al. 2020

IEEE Access

Self Cite

View full text Add to dashboard Cite

MAP estimation plays an important role in many probabilistic models. However, in many cases, the MAP problem is non-convex and intractable. In this work, we propose a novel algorithm, called BOPE, which uses Bernoulli randomness for Online Maximum a Posteriori Estimation. We show that BOPE has a fast convergence rate. In particular, BOPE implicitly employs a prior which plays as regularization. Such a prior is different from the one of the MAP problem and will be vanishing as BOPE does more iterations. This property of BOPE is significant and enables to reduce severe overfitting for probabilistic models in ill-posed cases, including short text, sparse data, and noisy data. We validate the practical efficiency of BOPE in two contexts: text analysis and recommender systems. Both contexts show the superior of BOPE over the baselines.

show abstract

Section: Case Study 1: Application To Text Analysismentioning

confidence: 92%