Camera System for Efficient non-contact Measurement in Distance Medicine

Kutílek, Patrik; Hejda, Jan; Lhotská, Lenka; Adolf, Jindřich; Doležal, Jaromír; Hourová, Michaela; Kral, Pavel; Birman, Raz; Hadar, Ofer

doi:10.1109/me49197.2020.9286647

Cited by 4 publications

(5 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are six basic physiotherapy exercises in the database, which have been carefully selected to be suitable for analyzing and processing with a single camera (two-dimensional processing see [ 3 ]), as illustrated in Figure 1 .…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Using EfficientNet-B7 (CNN), Variational Auto Encoder (VAE) and Siamese Twins’ Networks to Evaluate Human Exercises as Super Objects in a TSSCI Images

Segal

Hadar

Lhotská

2023

JPM

Self Cite

View full text Add to dashboard Cite

In this article, we introduce a new approach to human movement by defining the movement as a static super object represented by a single two-dimensional image. The described method is applicable in remote healthcare applications, such as physiotherapeutic exercises. It allows researchers to label and describe the entire exercise as a standalone object, isolated from the reference video. This approach allows us to perform various tasks, including detecting similar movements in a video, measuring and comparing movements, generating new similar movements, and defining choreography by controlling specific parameters in the human body skeleton. As a result of the presented approach, we can eliminate the need to label images manually, disregard the problem of finding the start and the end of an exercise, overcome synchronization issues between movements, and perform any deep learning network-based operation that processes super objects in images in general. As part of this article, we will demonstrate two application use cases: one illustrates how to verify and score a fitness exercise. In contrast, the other illustrates how to generate similar movements in the human skeleton space by addressing the challenge of supplying sufficient training data for deep learning applications (DL). A variational auto encoder (VAE) simulator and an EfficientNet-B7 classifier architecture embedded within a Siamese twin neural network are presented in this paper in order to demonstrate the two use cases. These use cases demonstrate the versatility of our innovative concept in measuring, categorizing, inferring human behavior, and generating gestures for other researchers.

show abstract

Section: Methodsmentioning

confidence: 99%

“…Remote healthcare utilizes human posture and gait for real-time medical rehabilitation [ 2 , 3 ]. The COVID-19 pandemic demonstrated the importance of remote diagnosis and treatment.…”

Section: Literature Reviewmentioning

confidence: 99%

Using EfficientNet-B7 (CNN), Variational Auto Encoder (VAE) and Siamese Twins’ Networks to Evaluate Human Exercises as Super Objects in a TSSCI Images

Segal

Hadar

Lhotská

2023

JPM

Self Cite

View full text Add to dashboard Cite

show abstract

“…The camera was in a horizontal position. Before starting the measurement, we calibrated the camera position using a laser system we developed [32]. An example of such a calculation was the angle between the center of the pelvis (A-8), the center of the shoulders (B-1) determined by OP, and the horizontal plane.…”

Section: Plos Onementioning

confidence: 99%

Evaluation of functional tests performance using a camera-based and machine learning approach

Adolf,

Segal,

Turna

et al. 2023

PLoS ONE

Self Cite

View full text Add to dashboard Cite

The objective of this study is to evaluate the performance of functional tests using a camera-based system and machine learning techniques. Specifically, we investigate whether OpenPose and any standard camera can be used to assess the quality of the Single Leg Squat Test and Step Down Test functional tests. We recorded these exercises performed by forty-six healthy subjects, extract motion data, and classify them to expert assessments by three independent physiotherapists using 15 binary parameters. We calculated ranges of movement in Keypoint-pair orientations, joint angles, and relative distances of the monitored segments and used machine learning algorithms to predict the physiotherapists’ assessments. Our results show that the AdaBoost classifier achieved a specificity of 0.8, a sensitivity of 0.68, and an accuracy of 0.7. Our findings suggest that a camera-based system combined with machine learning algorithms can be a simple and inexpensive tool to assess the performance quality of functional tests.

show abstract

“…There are six basic physiotherapy exercises in the database, which have been carefully selected to be suitable for analyzing and processing with a single camera (twodimensional processing), see (2). There are 30 participants in the database, who each perform six exercises.…”

Section: Patients Data Basementioning

confidence: 99%

“…Remote medicine utilizes human gestures to conduct real-time medical treatments (1) (2). For example, The COVID-19 pandemic demonstrated the importance of remote diagnosis and treatment.…”

Section: Introductionmentioning

confidence: 99%

Assessing Human Mobility by Constructing a Skeletal Database and Augmenting it Using a Generative Adversarial Network (GAN) Simulator

Hadar

Lhotska

2022

Studies in Health Technology and Informatics

View full text Add to dashboard Cite

This paper presents a neural network simulator based on anonymized patient motions that measures, categorizes, and infers human gestures based on a library of anonymized patient motions. There is a need for a sufficient training set for deep learning applications (DL). Our proposal is to extend a database that includes a limited number of videos of human physiotherapy activities with synthetic data. As a result of our posture generator, we are able to generate skeletal vectors that depict human movement. A human skeletal model is generated by using OpenPose (OP) from multiple-person videos and photographs. In every video frame, OP represents each human skeletal position as a vector in Euclidean space. The GAN is used to generate new samples and control the parameters of the motion. The joints in our skeletal model have been restructured to emphasize their linkages using depth-first search (DFS), a method for searching tree structures. Additionally, this work explores solutions to common problems associated with the acquisition of human gesture data, such as synchronizing activities and linking them to time and space. A new simulator is proposed that generates a sequence of virtual coordinated human movements based upon a script.

show abstract

Camera System for Efficient non-contact Measurement in Distance Medicine

Cited by 4 publications

References 10 publications

Using EfficientNet-B7 (CNN), Variational Auto Encoder (VAE) and Siamese Twins’ Networks to Evaluate Human Exercises as Super Objects in a TSSCI Images

Using EfficientNet-B7 (CNN), Variational Auto Encoder (VAE) and Siamese Twins’ Networks to Evaluate Human Exercises as Super Objects in a TSSCI Images

Evaluation of functional tests performance using a camera-based and machine learning approach

Assessing Human Mobility by Constructing a Skeletal Database and Augmenting it Using a Generative Adversarial Network (GAN) Simulator

Contact Info

Product

Resources

About