ObjectiveThe study presents a multi-channel patient-independent neonatal seizure detection system based on the Support Vector Machine (SVM) classifier.MethodsA machine learning algorithm (SVM) is used as a classifier to discriminate between seizure and non-seizure EEG epochs. Two post-processing steps are proposed to increase both the temporal precision and the robustness of the system. The resulting system is validated on a large clinical dataset of 267 h of EEG data from 17 full-term newborns with seizures.ResultsThe performance of the system using event-based metrics is reported. The system showed the best up-to-date performance of a neonatal seizure detection system. The system was able to achieve an average good detection rate of ∼89% with one false seizure detection per hour, ∼96% with two false detections per hour, or ∼100% with four false detections per hour. An analysis of errors revealed sources of misclassification in terms of both missed seizures and false detections.ConclusionsThe results obtained with the proposed SVM-based seizure detection system allow for its practical application in neonatal intensive care units.SignificanceThe proposed SVM-based seizure detection system can greatly assist clinical staff, in a neonatal intensive care unit, to interpret the EEG. The system allows control of the final decision by choosing different confidence levels which makes it flexible for clinical needs. The obtained results may provide a reference for future seizure detection systems.

ObjectiveThis study discusses an appropriate framework to measure system performance for the task of neonatal seizure detection using EEG. The framework is used to present an extended overview of a multi-channel patient-independent neonatal seizure detection system based on the Support Vector Machine (SVM) classifier.MethodsThe appropriate framework for performance assessment of neonatal seizure detectors is discussed in terms of metrics, experimental setups, and testing protocols. The neonatal seizure detection system is evaluated in this framework. Several epoch-based and event-based metrics are calculated and curves of performance are reported. A new metric to measure the average duration of a false detection is proposed to accompany the event-based metrics. A machine learning algorithm (SVM) is used as a classifier to discriminate between seizure and non-seizure EEG epochs. Two post-processing steps proposed to increase temporal precision and robustness of the system are investigated and their influence on various metrics is shown. The resulting system is validated on a large clinical dataset of 267 h.ResultsIn this paper, it is shown how a complete set of metrics and a specific testing protocol are necessary to extensively describe neonatal seizure detection systems, objectively assess their performance and enable comparison with existing alternatives. The developed system currently represents the best published performance to date with an ROC area of 96.3%. The sensitivity and specificity were ∼90% at the equal error rate point. The system was able to achieve an average good detection rate of ∼89% at a cost of 1 false detection per hour with an average false detection duration of 2.7 min.ConclusionsIt is shown that to accurately assess the performance of EEG-based neonatal seizure detectors and to facilitate comparison with existing alternatives, several metrics should be reported and a specific testing protocol should be followed. It is also shown that reporting only event-based metrics can be misleading as they do not always reflect the true performance of the system.SignificanceThis is the first study to present a thorough method for performance assessment of EEG-based seizure detection systems. The evaluated SVM-based seizure detection system can greatly assist clinical staff, in a neonatal intensive care unit, to interpret the EEG.

In recent years, numerous brain-computer interfaces (BCIs) based on motor-imagery have been proposed which incorporate features such as adaptive classification, error detection and correction, fusion with auxiliary signals and shared control capabilities. Due to the added complexity of such algorithms, the evaluation strategy and metrics used for analysis must be carefully chosen to accurately represent the performance of the BCI. In this article, metrics are reviewed and contrasted using both simulated examples and experimental data. Furthermore, a review of the recent literature is presented to determine how BCIs are evaluated, in particular, focusing on the relationship between how the data are used relative to the BCI subcomponent under investigation. From the analysis performed in this study, valuable guidelines are presented regarding the choice of metrics and evaluation strategy dependent upon any chosen BCI paradigm.

A real-time neonatal seizure detection system is proposed based on a Gaussian mixture model classifier. The system includes feature transformation techniques and classifier output postprocessing. The detector was evaluated on a database of 20 patients with 330 h of recordings. A detailed analysis of the choice of parameters for the detector is provided. A mean good detection rate of 79% was obtained with only 0.5 false detections per hour. A thorough review of all misclassified events was performed, from which a number of patterns causing false detections were identified.

This work presents a multi-channel patient-independent neonatal seizure detection system based on the SVM classifier. Several post-processing steps are proposed to increase temporal precision and robustness of the system and their influence on performance is shown. The SVM-based system is evaluated on a large clinical dataset using several epoch-based and event based metrics and curves of performance are reported. Additionally, a new metric to measure the average duration of a false detection is proposed to accompany the event-based metrics.