Unveiling the multimedia unconscious

Abstract

One of the main findings of cognitive sciences is that automatic processes of which we are unaware shape, to a significant extent, our perception of the environment. The phenomenon applies not only to the real world, but also to multimedia data we consume every day. Whenever we look at pictures, watch a video or listen to audio recordings, our conscious attention efforts focus on the observable content, but our cognition spontaneously perceives intentions, beliefs, values, attitudes and other constructs that, while being outside of our conscious awareness, still shape our reactions and behavior. So far, multimedia technologies have neglected such a phenomenon to a large extent. This paper argues that taking into account cognitive effects is possible and it can also improve multimedia approaches. As a supporting proof-of-concept, the paper shows not only that there are visual patterns correlated with the personality traits of 300 Flickr users to a statistically significant extent, but also that the personality traits (both self-assessed and attributed by others) of those users can be inferred from the images these latter post as "favourite".

Zwischen Tradition Und Moderne

“…Im Gegensatz hierzu scheint gerade die Vielzahl verschiedener Reize in Bildern interessant, wie wir ihnen im täglichen Leben immer wieder begegnen. Dafür spricht, dass Persönlichkeitseigenschaften neben inhaltlichen und ästhetischen Reizen in Bildern durch eine Vielzahl weiterer Reize angesprochen werden (Van Der Heide, D'Angelo & Schumaker, 2012) und Personen implizite Informationen aus Bildern ableiten, wie beispielsweise Werte und Einstellungen (Cristani, Vinciarelli, Segalin & Perina, 2015). Die genannten Studien zur Vorhersage von Persönlichkeitseigenschaften anhand normaler Fotos aus sozialen Netzwerken zeigen, dass auch komplexe Bilder Informationen über Persönlichkeitseigenschaften beinhalten.…”

Аbout of the Correlation Relations of «big Five» Personality Factors

“…Важным показателем является и степень согласованности экспертов-психологов, проводивших исследования. Однако только в работе [7] был проведен анализ степени согласованности, которая, тем не менее, оказалась весьма низкой.…”

Towards Job Screening and Personality Traits Estimation From Video Transcriptions

“…Biel et al [3] used Youtube vloggers video frames to estimate personality impressions using facial expressions and the Big-Five traits. Likewise, Cristani et al [11] showed that images in which the users "favorite" on Flickr enables the prediction of both apparent and actual (self-assessed) personality traits of Flickr users. Again, Vernon et al [58] investigated the effects of several physical attributes, for instance, the head size, posture, and chin-length on person's impressions.…”