The impact of visual and motor skills on ideational apraxia and transcortical sensory aphasia

Afshangian, Fazlallah; Wellington, Jack; Pashmoforoosh, Radnoosh; Farzadfard, Mohammad Taghi; Noori, Narges Khatoon; Jaberi, Abbas Rahimi; Ostovan, Vahid Reza; Soltani, Aboozar; Safari, Hosein; Foroughi, Amin Abolhasani; Önen, Mehmet Reşid; Montemurro, Nicola; Chaurasia, Bipin; Akgül, Erol; Freddi, Tomas; Ermis, Abdulkadir; Amirifard, Hamed; Habibi, Saiyed Amir Hasan; Manzarinezad, Motahereh; Bozkurt, İsmail; Yağmurlu, Kaan; Sirjani, Ehsan Baradran; Wagner, Aurel Popa

doi:10.1080/23279095.2023.2204527

Cited by 3 publications

(3 citation statements)

References 43 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The features of arbitrary regulation make it possible to form prerequisites for human activity at the level of behavioral and emotional reactions that interact with his self-expression at the level of speech. In case of speech impairment, this factor is of particular importance, since it allows you to better understand a person (patient), form common parameters with him at the level of interaction; develop ways to solve this issue, where provoking criteria that cause negative reactions and actions in a patient with aphasia will be excluded [7]. Initially, it is known that the formation of behavioral-emotional-speech reactions is associated with a human mental activity.…”

Section: Resultsmentioning

confidence: 99%

“…This neuropsychological method allows examining the degree of ability and skill to switch between visual perceptions and performing the task of connecting cards with sequential numbers. The methods used in the research create conditions for determining the speed of perception of the presented information, visual perception and attention, which has the prerequisites for creating a stimulus for subsequent action, the formation of a reaction to the choice of personal action, emotional reactions at the level of solving a cognitive task, the development of personal sensorimotor manifestations against the background of solving a problem posed during testing, self-expression in the implementation of the cognitive task of the communication series, including selfcontrol and fulfillment of the target task of the test in multifactorial personal manifestations, which in general makes it possible to identify the features of the manifestation of a patient with aphasia at the level of arbitrary regulation of activity [7]. When calculating the obtained research data, the standard method of mathematical calculation of results was used.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Specific Character of Arbitrary Regulation in Various Forms of Aphasia

2024

Russian Law Journal

View full text Add to dashboard Cite

The relevance of the research presented in this article is determined by the high prevalence of speech disorders among patients of various profiles. Currently, aphasia accompanies various diseases, which may naturally affect the formation and development of arbitrary regulation among this category of patients, disrupting their processes of self-control in behavioral and emotional reactions. The aim of the article is to identify the features of arbitrary regulation in case of sensory and motor aphasia. The method of studying of the outlined problem is the diagnosis of manifestations of human behavior at the level of arbitrary regulation. For this purpose, the tests "Serial Picture and Story Arrangement" and "Path Tracing" were used. They allow assessing the patient's abilities to concentrate attention, analyze speech text, and exercise emotional and motor self-control. The parameters identified during the study made it possible to distinguish differences in the manifestation of arbitrary regulation at the level of patients with motor and sensory aphasia. In case of sensory aphasia, aspects of low attention concentration and programming activity are observed; a high threshold of emotional excitability alongside with the unstable psycho-emotional sphere can be detected. At the same time, patients with motor aphasia demonstrate the ability to concentrate attention on task performance, stability of psycho-emotional indicators, and high abilities of understanding and analyzing the speech addressed to them. The data obtained during the study will allow specialists to improve the diagnostic, communicative, and neurorehabilitation procedures, thereby enhancing the possibilities for speech restoration in patients with aphasia, which may have practical value for the medical-social sphere.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Specific Character of Arbitrary Regulation in Various Forms of Aphasia

2024

Russian Law Journal

View full text Add to dashboard Cite

show abstract

“…Moreover, Doughty et al [10] proposed a pairwise deep ranking model that utilizes both spatial and temporal streams in combination with a novel loss function to determine and rank skill levels. Moreover, Afshangian et al [11] evaluated motor skills using the Bilingual Aphasia Test (BAT) and conducted appropriate behavioral assessments, including coordination tests, visual-motor tests, and speech processing. Baeyens et al [12] employed surface electromyography (sEMG) to capture the activity of the upper trapezius muscle (UT) during the prolonged playing of fast and slow music in 10 conservatory piano students.…”

Section: Traditional Skills Assessmentmentioning

confidence: 99%

A ResNet-Based Audio-Visual Fusion Model for Piano Skill Evaluation

2023

View full text Add to dashboard Cite

With the rise in piano teaching in recent years, many people have joined the ranks of piano learners. However, the high cost of traditional manual instruction and the exclusive one-on-one teaching model have made learning the piano an extravagant endeavor. Most existing approaches, based on the audio modality, aim to evaluate piano players’ skills. Unfortunately, these methods overlook the information contained in videos, resulting in a one-sided and simplistic evaluation of the piano player’s skills. More recently, multimodal-based methods have been proposed to assess the skill level of piano players by using both video and audio information. However, existing multimodal approaches use shallow networks to extract video and audio features, which limits their ability to extract complex spatio-temporal and time-frequency characteristics from piano performances. Furthermore, the fingering and pitch-rhythm information of the piano performance is embedded within the spatio-temporal and time-frequency features, respectively. Therefore, we propose a ResNet-based audio-visual fusion model that is able to extract both the visual features of the player’s finger movement track and the auditory features, including pitch and rhythm. The joint features are then obtained through the feature fusion technique by capturing the correlation and complementary information between video and audio, enabling a comprehensive and accurate evaluation of the player’s skill level. Moreover, the proposed model can extract complex temporal and frequency features from piano performances. Firstly, ResNet18-3D is used as the backbone network for our visual branch, allowing us to extract feature information from the video data. Then, we utilize ResNet18-2D as the backbone network for the aural branch to extract feature information from the audio data. The extracted video features are then fused with the audio features, generating multimodal features for the final piano skill evaluation. The experimental results on the PISA dataset show that our proposed audio-visual fusion model, with a validation accuracy of 70.80% and an average training time of 74.02 s, outperforms the baseline model in terms of performance and operational efficiency. Furthermore, we explore the impact of different layers of ResNet on the model’s performance. In general, the model achieves optimal performance when the ratio of video features to audio features is balanced. However, the best performance achieved is 68.70% when the ratio differs significantly.

show abstract

A ResNet-based Audio-visual Fusion Model for Piano Skill Evaluation

Zhao¹,

Wang²,

Cai³

2023

Preprint

View full text Add to dashboard Cite

With the rise of piano teaching in recent years, many people have joined the team of piano learners. However, the expensive cost of manual instruction and the unique one-on-one teaching model have made piano learning an extravagant event. Most existing approaches based on the audio modality aim to evaluate piano players' skills. Unfortunately, these methods ignored the information contained in the video, which led to a one-sided and simplistic evaluation of the piano player's skills. More recently, multimodal-based methods are proposed to assess the skill level of piano players using both video and audio information. However, existing multimodal approaches use shallow networks to extract video and audio features, which are deficient in extracting complex spatio-temporal and time-frequency features from piano performance. Furthermore, the fingering and the pitch-rhythm information of the piano performance is contained in the spatio-temporal and time-frequency features, respectively. In the paper, we propose a ResNet-based audio-visual fusion model that combines video and audio features to assess the skill level of piano players. Firstly, ResNet18-3D is used as the backbone network for our visual branches, which can extract feature information from the video data. Then, we consider ResNet18-2D as the backbone network of the aural branch and extract the feature information from the audio data. The extracted video features are fused with the audio features to generate multimodal features for the final piano skill evaluation. The experimental results on the PISA dataset show that our proposed audio-visual fusion model, with a validation accuracy of 70.80%, outperforms the state-of-the-art methods in both performance and efficiency. Then, we also explore the impact of different layers of ResNet on model performance, and the experimental results show that the audio-visual fusion model dealing with the piano skill assessment problem can make full use of both feature information when the number of video features is close to the number of audio features.

show abstract

The impact of visual and motor skills on ideational apraxia and transcortical sensory aphasia

Cited by 3 publications

References 43 publications

Specific Character of Arbitrary Regulation in Various Forms of Aphasia

Specific Character of Arbitrary Regulation in Various Forms of Aphasia

A ResNet-Based Audio-Visual Fusion Model for Piano Skill Evaluation

A ResNet-based Audio-visual Fusion Model for Piano Skill Evaluation

Contact Info

Product

Resources

About