Interest Level Estimation Based on Feature Integration Considering Distribution of Partially Paired User’s Behavior, Videos and Posters

Kamikawa, Kyohei; Maeda, Kazuo; Ogawa, Takahiro; Haseyama, Miki

doi:10.1109/gcce50665.2020.9291757

Cited by 2 publications

(1 citation statement)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In this subsection, the dataset used in the experiments is explained. In the present experiment, 49 movie trailers obtained from YouTube 3 are used, similar to previous studies [6], [20], [30]. In particular, ten trailers each from "science," "music," "action," and "comedy" genres, and nine from the "sports" genre are used.…”

Section: A Datasetmentioning

confidence: 99%

Feature Integration Through Semi-Supervised Multimodal Gaussian Process Latent Variable Model With Pseudo-Labels for Interest Level Estimation

et al. 2021

Self Cite

View full text Add to dashboard Cite

This study presents a novel feature integration method for interest level estimation using a semi-supervised multimodal Gaussian process latent variable model with pseudo-labels (semi-MGPPL). Semi-MGPPL is an extended version of the multimodal Gaussian process latent variable model (mGPLVM). It integrates features calculated from multiple modalities to predict the users' interest levels in content. It is known that reflecting known interest levels of known users in the latent space effectively improves the accuracy of interest level estimation. However, previous methods have difficulty reflecting the interest levels when the number of samples is insufficient. Semi-MGPPL efficiently reflects interest levels in the latent space by pseudo-labeling of unlabeled samples and increasing the number of available pairs among labeled samples. In addition, obtaining behavior features is difficult for a new test sample. However, requirement of features of all modalities by previous mGPLVM-based methods makes the calculation of latent variables of a test sample challenging. Semi-MGPPL solves this problem by training a projection function from the original feature to the latent space. The experimental results on real data demonstrate the effectiveness and robustness of semi-MGPPL.INDEX TERMS Gaussian process, multimodal analysis, feature integration, semi-supervised learning, pseudo-label.

show abstract

Section: A Datasetmentioning

confidence: 99%