The number of patients with neurological diseases is currently increasing annually, which presents tremendous challenges for both patients and doctors. With the advent of advanced information technology, digital medical care is gradually changing the medical ecology. Numerous people are exploring new ways to receive a consultation, track their diseases, and receive rehabilitation training in more convenient and efficient ways. In this paper, we explore the use of facial expression recognition via artificial intelligence to diagnose a typical neurological system disease, Parkinson disease (PD). This study proposes methods to diagnose PD through facial expression recognition. We collected videos of facial expressions of people with PD and matched controls. We used relative coordinates and positional jitter to extract facial expression features (facial expression amplitude and shaking of small facial muscle groups) from the key points returned by Face++. Algorithms from traditional machine learning and advanced deep learning were utilized to diagnose PD. The experimental results showed our models can achieve outstanding facial expression recognition ability for PD diagnosis. Applying a long short-term model neural network to the positions of the key features, precision and F1 values of 86% and 75%, respectively, can be reached. Further, utilizing a support vector machine algorithm for the facial expression amplitude features and shaking of the small facial muscle groups, an F1 value of 99% can be achieved. This study contributes to the digital diagnosis of PD based on facial expression recognition. The disease diagnosis model was validated through our experiment. The results can help doctors understand the real-time dynamics of the disease and even conduct remote diagnosis.
BACKGROUND Parkinson’s disease (PD) is one of the most common neurological diseases. At present, because the exact cause is still unclear, accurate diagnosis and progression monitoring remain challenging. In recent years, exploring the relationship between Parkinson's disease and speech disorder has attracted widespread attention in the academic world. Most of the work successfully validate the effectiveness of some vocal features. Moreover, the non-invasive nature of speech signal-based testing has pioneered a new way to realize telediagnosis and telemonitoring. In particular, there is an increasing demand for AI-powered tools in the digital health era. OBJECTIVE This study aimed to build a real-time speech signal analysis tool for PD diagnosis and severity assessment. Further, the underlying system should be scalable to integrate any traditional machine learning or advanced deep learning algorithms. METHODS At its core, the system consists of two parts: 1) Speech signals processing: both traditional and novel speech signal processing technologies were used for feature engineering, which can automatically extract linear and nonlinear dysphonia features. 2) Application of machine learning algorithms: some classical regression and classification algorithms from machine learning field were tested, and we then chose the most efficient algorithms and relevant features. RESULTS Experimental results showed our system’s outstanding ability in both PD diagnosis and severity assessment. If we used both linear and nonlinear dysphonia features, Support Vector Machine (SVM) achieved the best results with accuracy 88.74% and recall 97.03% in the diagnosis task. Meanwhile, in the assessment task, Support Vector Regression (SVR) performed best with mean absolute error (MAE) 3.7699. Moreover, the system has a well-designed architecture that is scalable to advanced algorithms and it has already been deployed into a mobile application called “No Pa”. CONCLUSIONS This study explored the diagnosis and severity assessment of PD from speech order detection perspective. The efficiency and effectiveness our tool contribute to telediagnosis and telemonitoring of the Parkinson’s disease. The real-time feedback can also optimize the decision-making process of the doctor's treatment. CLINICALTRIAL N/A
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
customersupport@researchsolutions.com
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.