Development of video-based emotion recognition using deep learning with Google Colab

Abstract

Emotion recognition using images, videos, or speech as input is considered as a hot topic in the field of research over some years. With the introduction of deep learning techniques, e.g., convolutional neural networks (CNN), applied in emotion recognition, has produced promising results. Human facial expressions are considered as critical components in understanding one's emotions. This paper sheds light on recognizing the emotions using deep learning techniques from the videos. The methodology of the recognition process, along with its description, is provided in this paper. Some of the video-based datasets used in many scholarly works are also examined. Results obtained from different emotion recognition models are presented along with their performance parameters. An experiment was carried out on the fer2013 dataset in Google Colab for depression detection, which came out to be 97% accurate on the training set and 57.4% accurate on the testing set.

Analysis of EfficientNetV2 Model Usage in Predicting Gender on the Face of Mask Users

“…Hampir setiap aktivitas manusia selalu mengharapkan hasil yang maksimal sehingga diperlukan pernan teknologi [7]. Peningkatan luar biasa dalam perkembangan teknologi interaksi manusia-komputer yang canggih memungkinkan persoalan yang berhubungan dengan biometrik dapat diselesaikan bukan hanya sekedar mendeteksi jenis kelamin melainkan situasi mood seseorang juga dapat dipredisksi [8].…”

End-to-end deep auto-encoder for segmenting a moving object with limited training data

“…In our experiments, we perform our implementation using an open-source library called Keras which was developed in 2018 by Chollet et al [33]. The training process is done on the Google Colaboratory platform through a Tesla K80 GPU [34], [35] for 100 epochs. We selected the RMSprop as the main optimizer to train our model.…”

MusicApp, A Music Sheet Transcribing Moblie Platform using Machine Learning and Nature Language Processing

“…The third challenge is the creation of the app ui, we used flutter to create an android app using an android emulator [7]. Flutter is constantly used for creation of android and IOS app and doesn't supply much back end resources for audio or musical uses [8].We had to create the back end that wasn't linked with flutter and is on the google collab that is able to pull online python packages capable of overcoming the challenges needed [9]. Since flutter and google collab are not linked by any direct path or package, we had to create our own way to send audio information from the app into the converter and from the converter back into the app.…”