Markerless Analysis of Articulatory Movements in Patients With Parkinson's Disease

Abstract

Summary: Objectives. A large percentage of patients with Parkinson's disease have hypokinetic dysarthria, exhibiting reduced peak velocities of jaw and lips during speech. This limitation implies a reduction of speech intelligibility for such patients. This work aims at testing a cost-effective markerless approach for assessing kinematic parameters of hypokinetic dysarthria. Study Design. Kinematic parameters of the lips are calculated during a syllable repetition task from 14 Parkinsonian patients and 14 age-matched control subjects. Methods. Combining color and depth frames provided by a depth sensor (Microsoft Kinect), we computed the threedimensional coordinates of main facial points. The peak velocities and accelerations of the lower lip during a syllable repetition task are considered to compare the two groups. Results. Results show that Parkinsonian patients exhibit reduced peak velocities of the lower lip, both during the opening and the closing phase of the mouth. In addition, peak values of acceleration are reduced in Parkinsonian patients, although with significant differences only in the opening phase with respect to healthy control subjects. Conclusions. The novel contribution of this work is the implementation of an entirely markerless technique capable to detect signs of hypokinetic dysarthria for the analysis of articulatory movements during speech. Although a large number of Parkinsonian patients have hypokinetic dysarthria, only a small percentage of them undergoes speech therapy to increase their articulatory movements. The system proposed here could be easily implemented in a home environment, thus, increasing the percentage of patients who can perform speech rehabilitation at home.

An Innovative Serious Game for the Detection and Rehabilitation of Oral-Facial Malfunction in Children: A Pilot Study

“…Furthermore, in support of our findings, the 19 expressions analyzed by Cao et al include kissing, smiling, and raising the eyebrows [16]; lastly, (3) a study that was published using Kinect as a tool for the detection and rehabilitation of people with Parkinson's, which was considered as a highly valid tool due to its low cost and ease of use in the home [17]. It is difficult to compare studies with the same type of technology or similar to those that have been done, to date, among adults.…”

Video-Based Tracking of Jaw Movements During Speech: Preliminary Results and Future Directions

“…The average root mean square error (RMSE) of the lip points with respect to an optoelectronic marker-based method ranged between 1 and 4 mm. The validity of the above video-based method was also demonstrated in a clinical population of individuals diagnosed with PD [12]. We were able to discriminate patients with PD from healthy controls, using lower lip movements during syllable repetitions.…”

Automatic Detection of Orofacial Impairment in Stroke

“…The increasing availability of accurate, low-cost depth sensors, along with the development of efficient face alignment algorithms provide a great opportunity to introduce novel and intelligent systems in clinical environments [15], [16]. Previous studies demonstrated the feasibility of 3D video-based approaches for the assessment of motor speech disorders in patients with Parkinson's disease and amyotrophic lateral sclerosis (ALS) [17]- [19]. In this work, we aim to expand those findings to the automatic assessment of orofacial impairment in patients PS, evaluating facial movements during speech and non-speech tasks.…”