Brain Painting: First Evaluation of a New Brain–Computer Interface Application with ALS-Patients and Healthy Volunteers

Abstract

Brain–computer interfaces (BCIs) enable paralyzed patients to communicate; however, up to date, no creative expression was possible. The current study investigated the accuracy and user-friendliness of P300-Brain Painting, a new BCI application developed to paint pictures using brain activity only. Two different versions of the P300-Brain Painting application were tested: A colored matrix tested by a group of ALS-patients (n = 3) and healthy participants (n = 10), and a black and white matrix tested by healthy participants (n = 10). The three ALS-patients achieved high accuracies; two of them reaching above 89% accuracy. In healthy subjects, a comparison between the P300-Brain Painting application (colored matrix) and the P300-Spelling application revealed significantly lower accuracy and P300 amplitudes for the P300-Brain Painting application. This drop in accuracy and P300 amplitudes was not found when comparing the P300-Spelling application to an adapted, black and white matrix of the P300-Brain Painting application. By employing a black and white matrix, the accuracy of the P300-Brain Painting application was significantly enhanced and reached the accuracy of the P300-Spelling application. ALS-patients greatly enjoyed P300-Brain Painting and were able to use the application with the same accuracy as healthy subjects. P300-Brain Painting enables paralyzed patients to express themselves creatively and to participate in the prolific society through exhibitions.

Artistic brain-computer interfaces: state-of-the-art control mechanisms

“…Levels of control necessary for satisfaction or entertainment may vary for each type of user group. As reported in [18], disabled participants reported greater enjoyment of the tasks than their healthy counterparts, despite their accuracies being lower. If accuracy is an indicator of control, varying degrees of control may be necessary for different users to feel satisfied or entertained.…”

“…That being said, the level of control afforded by this BCI is more direct in that users are intentionally making decisions on what precise note they would like to hear the BCI application play. Münßinger et al [18] produced an artistic BCI application that allows users to paint by using a modified P300-speller interface equipped with a 6 × 8 matrix including choices such as color, object, size, transparency, zoom, and cursor movement. These options gave users the freedom to create a painting of their choice without being overly limited.…”

“…[ [17][18][19][20] Collaborative Allows multiple users to interact with each other or individually but collectively, to create unique artistic experiences. Collaborative control generally also falls under the categories of passive or selective control, but with multiple users.…”

“…When users are in a relaxed state, their alpha waves (7-13 Hz) are transmitted and the steel sky is silent, other than one 'ding' every four seconds. When users are focused, beta rhythms (13)(14)(15)(16)(17)(18)(19)(20)(21)(22)(23)(24)(25)(26)(27)(28)(29)(30) are present and the steel sky lights up with cacophonous sounds of banging steel. The musical feedback prompts the user to either continue in their same mental state, or to attempt to change their current brainwave frequencies, depending on personal preference.…”

Application of P300 Event-Related Potential in Brain-Computer Interface

“…A P300 BCI application known as "Brain Painting" (BP) offers a medium of entertainment for the patients by improving their playful mood [56].…”