Human Psychophysiological Activity Estimation Based on Smartphone Camera and Wearable Electronics

Abstract

<jats:p>This paper presents a study related to human psychophysiological activity estimation based on a smartphone camera and sensors. In recent years, awareness of the human body, as well as human mental states, has become more and more popular. Yoga and meditation practices have moved from the east to Europe, the USA, Russia, and other countries, and there are a lot of people who are interested in them. However, recently, people have tried the practice but would prefer an objective assessment. We propose to apply the modern methods of computer vision, pattern recognition, competence management, and dynamic motivation to estimate the quality of the meditation process and provide the users with objective information about their practice. We propose an approach that covers the possibility of recognizing pictures of humans from a smartphone and utilizes wearable electronics to measure the user’s heart rate and motions. We propose a model that allows building meditation estimation scores based on these parameters. Moreover, we propose a meditation expert network through which users can find the coach that is most appropriate for him/her. Finally, we propose the dynamic motivation model, which encourages people to perform the practice every day.</jats:p>

Estimation of Motion and Respiratory Characteristics during the Meditation Practice Based on Video Analysis

“…Our dataset consists of more than 90 videos for 17 different people [ 8 ] who vary in age, gender and level of meditation experience. For the breathing analysis, we show the results for four different meditators: three beginners and one professional.…”

“…The RR is calculated for each graph using a sliding window with the length of 300 frames (60 s) and the stride five frames (1 s), which means that the RR calculated for the period where t is the time in seconds and T is the total time of the video. The RR is considered high if it is over ten breaths per second [ 8 ].…”

“…In this section, we describe the evaluation of the meditation process that is an enhancement of our previous paper [ 8 ]. In this paper, we make the evaluation based on the breathing and movements parameter according to the proposed model (see Table 2 ).…”

“…In this paper, we present an approach to meditation practice evaluation based on image analysis. We have enhanced our previous research [ 8 , 9 ] on this topic. The scientific novelty of the presented paper is as follows: we propose an evaluation system for meditation practice based on image analysis, a contactless method for measuring the respiratory rate using a mobile phone camera, and a method for body parts movement detection with detection of the direction of movement.…”

On Driver Behavior Recognition for Increased Safety: A Roadmap

“…In addition to driver monitoring based on thermal cameras, a further emphasis can be placed on the use of normal and general-purpose imaging sensors, such as in-vehicle fixed cameras, or the front camera of a smartphone [116,117]. This is further motivated by their well-known portability and widespread diffusion in society, thus representing an optimal way to gather data and information [118].…”