Extracting human emotions at different places based on facial expressions and spatial clustering analysis

Abstract

The emergence of big data enables us to evaluate the various human emotions at places from a statistical perspective by applying affective computing. In this study a novel framework for extracting human emotions from large‐scale georeferenced photos at different places is proposed. After the construction of places based on spatial clustering of user‐generated footprints collected from social media websites, online cognitive services are utilized to extract human emotions from facial expressions using state‐of‐the‐art computer vision techniques. Two happiness metrics are defined for measuring the human emotions at different places. To validate the feasibility of the framework, we take 80 tourist attractions around the world as an example and a happiness ranking list of places is generated based on human emotions calculated over 2 million faces detected from greater than 6 million photos. Different kinds of geographical contexts are taken into consideration to find out the relationship between human emotions and environmental factors. Results show that much of the emotional variation at different places can be explained by a few factors such as openness. The research offers insights into integrating human emotions to enrich the understanding of sense of place in geography and in place‐based GIS.

Understanding the spatial dimension of natural language by measuring the spatial semantic similarity of words through a scalable geospatial context window

“…The term ‘spatial context semantics’ can be understood from the perspectives of spatial ontology and cognition. All aspects of human activity are rooted in geographic space, including individual behaviours and languages [ 41 – 46 ]. Language expressions also stem from individuals’ understanding of the world and their cognition of the environment.…”

Classification and mapping of urban canyon geometry using Google Street View images and deep multitask learning

“…Recently, deep learning-based models have been applied to a variety of computer vision tasks and have achieved great success in many applications such as image classification [24,25], image attribute prediction [26,27], image scene segmentation [28,29] and helping researchers understand places and cities [30,31]. Deep convolutional neural networks (DCNNs), which take inspiration from the neural structure of human brains, can automatically learn efficient features and conduct various visual inference tasks [32][33][34].…”

Who likes whom? The interaction between perceiver personality and target look

“…An intriguing question is to what extent the results pertaining to non-Duchenne smiles are culture specific. Although Finland, and European countries in general, tend to receive high scores on largescale cross-cultural happiness surveys, such as the World Happiness Survey (Helliwell et al, 2019), people in these countries smile less than people on any other continent, at least as judged from their social media content (Kang et al, 2019). It could be that in cultures in which smiling is more normative, also non-Duchenne smiles would be viewed more positively.…”