Extraction of spatial information for low-bandwidth telerehabilitation applications

Abstract

Abstract-Telemedicine applications, based on two-dimensional (2D) video conferencing technology, have been around for the past 15 to 20 yr. They have been demonstrated to be acceptable for face-to-face consultations and useful for visual examination of wounds and abrasions. However, certain telerehabilitation assessments need the use of spatial information in order to accurately assess the patient's condition and sending three-dimensional video data over low-bandwidth networks is extremely challenging. This article proposes an innovative way of extracting the key spatial information from the patient's movement during telerehabilitation assessment based on 2D video and then presenting the extracted data by using graph plots alongside the video to help physicians in assessments with minimum burden on existing video data transfer. Some common rehabilitation scenarios are chosen for illustrations, and experiments are conducted based on skeletal tracking and color detection algorithms using the Microsoft Kinect sensor. Extracted data are analyzed in detail and their usability discussed.

Development of telerehabilitation application with designated consultation categories

“…Spatial data extraction, as mentioned by Tan et al [20], is optional in this category, with the user having the ability to activate it when needed. Figure 2 shows a sample screenshot of the application at the patient's side when the FM category is chosen and color information from the patient's end is activated.…”