This paper presents a novel multimodal virtual rehabilitation environment. Its design and implementation are based on principles related to intrinsic motivation and game design. The system consists of visual, acoustic, and haptic modalities. Elements contributing to intrinsic motivation are carefully joined in the three modalities to increase patients' motivation during the long process of rehabilitation. The message in a bottle (MIB) virtual scenario is designed to allow interplay between motor and cognitive challenges in the exercising patient. The user first needs to perform a motor action to receive a cognitive challenge that is finally solved by a second motor action. Visual feedback provides the most relevant information related to the task. Acoustic feedback consists of environmental sounds, music, and spoken instructions or encouraging statements for the patient. The haptic modality generates tactile information related to the environment and provides various modes of assistance for the patient's arm movements. The MIB scenario was evaluated with 16 stroke patients, who rated it positively using the Intrinsic Motivation Inventory questionnaire. Additionally, the MIB scenario seems to elicit higher motivation than a simpler pick-and-place training task.

This paper presents the analysis of four psychophysiological responses in post-stroke upper extremity rehabilitation. The goal was to determine which psychophysiological responses would provide the most reliable information about subjects' psychological states during rehabilitation. Heart rate, skin conductance, respiration, and skin temperature were recorded in a stroke group and a control group during two difficulty levels of a pick-and-place task performed in a virtual environment using a haptic robot and during a cognitive task. Psychophysiological measurements were correlated with results of a self-report questionnaire. All four responses showed significant changes in response to the different tasks. Skin conductance differentiated between the two difficulty levels and was correlated with self-reported arousal in both stroke and control groups. Skin temperature differentiated between the two difficulty levels for the control group, but provided poor results for the stroke group. Heart rate and respiration increased during tasks, but their connection to psychological state was unclear. Results suggest that, of the four measured responses, skin conductance offers the most potential as a psychological state indicator, with other measures providing supplementary information. Psychophysiological measurements could thus be used in closed-loop biocooperative systems that would detect the user's psychological state and change the course of therapy accordingly.

This paper examines the usefulness of psychophysiological measurements in a biocooperative feedback loop that adjusts the difficulty of an upper extremity rehabilitation task. Psychophysiological measurements (heart rate, skin conductance, respiration, and skin temperature) were used both by themselves and in combination with task performance and biomechanics. Data fusion was performed with discriminant analysis, and a special adaptive version was implemented that can gradually adapt to a subject. Both healthy subjects and hemiparetic patients participated in the study. The accuracy of the biocooperative controller was defined as the percentage of times it matched the subjects' preferences. The highest accuracy rate was obtained for task performance (approximately 82% for both healthy subjects and patients), with psychophysiological measurements yielding relatively low accuracy (approximately 60%). The adaptive approach increased accuracy of psychophysiological measurements to 76.4% for healthy subjects and 68.8% for patients. Combining psychophysiology with task performance yielded an accuracy rate of 84.7% for healthy subjects and 89.4% for patients. Results suggest that psychophysiological measurements are not reliable as a primary data source in motor rehabilitation, but can provide supplementary information. However, it is questionable whether the amount of additional information justifies the increased complexity of the system.

BackgroundRobotic systems are becoming increasingly common in upper extremity stroke rehabilitation. Recent studies have already shown that the use of rehabilitation robots can improve recovery. This paper evaluates the effect of different modes of robot-assistances in a complex virtual environment on the subjects' ability to complete the task as well as on various haptic parameters arising from the human-robot interaction.MethodsThe MIMICS multimodal system that includes the haptic robot HapticMaster and a dynamic virtual environment is used. The goal of the task is to catch a ball that rolls down a sloped table and place it in a basket above the table. Our study examines the influence of catching assistance, pick-and-place movement assistance and grasping assistance on the catching efficiency, placing efficiency and on movement-dependant parameters: mean reaching forces, deviation error, mechanical work and correlation between the grasping force and the load force.ResultsThe results with groups of subjects (23 subacute hemiparetic subjects, 10 chronic hemiparetic subjects and 23 control subjects) showed that the assistance raises the catching efficiency and pick-and-place efficiency. The pick-and-place movement assistance greatly limits the movements of the subject and results in decreased work toward the basket. The correlation between the load force and the grasping force exists in a certain phase of the movement. The results also showed that the stroke subjects without assistance and the control subjects performed similarly.ConclusionsThe robot-assistances used in the study were found to be a possible way to raise the catching efficiency and efficiency of the pick-and-place movements in subacute and chronic subjects. The observed movement parameters showed that robot-assistances we used for our virtual task should be improved to maximize physical activity.

No abstract