Standardized measurement error: A universal metric of data quality for averaged event‐related potentials

Luck, Steven J.; Stewart, Andrew X; Simmons, Aaron M.; Rhemtulla, Mijke

doi:10.1111/psyp.13793

Cited by 131 publications

(179 citation statements)

References 26 publications

Supporting

Mentioning

151

Contrasting

Order By: Relevance

“…S4). Using the method proposed by Luck et al (2020), only the SNR values for the P60 peak (at T2, T15, and T30 for iTBS and cTBS and T2 for sham) were below a recommended threshold of 10 (Luck, 2005) (Supplementary Table S5). Qualitatively, earlier peaks (N40 and P60) had a lower SNR than the later ones (N100 and P200).…”

Section: Resultsmentioning

confidence: 99%

“…−500 to −50 ms), as used in previous TEP (Chung et al, 2017) and ERP studies (Debener et al, 2007, Hu et al, 2010). We also used the approach proposed by Luck et al (2020) that estimates data quality using a ratio between the TEP amplitude (signal) and the standardised measurement error (SME) estimated by bootstrapping for that amplitude (noise).…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Assessing neuromodulation effects of theta burst stimulation to the prefrontal cortex using TMS-evoked potentials

AHdM

Nikolin

Martin

et al. 2021

Preprint

View full text Add to dashboard Cite

Theta burst stimulation (TBS), a form of repetitive transcranial magnetic stimulation (TMS), is capable of non-invasively modulating cortical excitability. TBS is gaining popularity as a therapeutic tool for psychiatric disorders such as depression, in which the dorsolateral prefrontal cortex (DLPFC) is the main therapeutic target. However, the neuromodulatory effects of TBS on prefrontal regions remain unclear. An emerging tool to assess neuromodulation in non-motor regions is concurrent transcranial magnetic stimulation and electroencephalography (TMS-EEG) to measure TMS-evoked potentials (TEPs). We assessed twenty-four healthy participants (13 males, mean age 25.2±9.9 years) following intermittent TBS, continuous TBS, and sham applied to the left DLPFC using a double-blinded crossover design. TEPs were obtained at baseline and 2-, 15-, and 30-min post-stimulation. Four TEP components (N40, P60, N100 and P200) were analysed using mixed effects repeated measures models (MRMM). Results indicate no significant effects for any assessed components (all p>.05). The largest effect size (Cohens d = -0.5) comparing iTBS and sham was obtained for the N100 component at 15 minutes post-stimulation. This result was in the same direction but smaller than found in previous studies, suggesting that the true effect size may be lower than previously reported. Accurate estimates of the effects sizes and inter-individual heterogeneity will critically inform clinical applications using TEPs to assess the neuromodulatory effects of TBS.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

Assessing neuromodulation effects of theta burst stimulation to the prefrontal cortex using TMS-evoked potentials

AHdM

Nikolin

Martin

et al. 2021

Preprint

View full text Add to dashboard Cite

show abstract

“…A second step moving the field toward more optimized recording methods was to develop a new metric of data quality for averaged ERPs, named the standardized measurement error (SME) (Luck et al, 2021). If researchers were to regularly compute the SME and report it in publications, the field could accumulate objective information about which recording methods are best for a given paradigm or measure.…”

Section: Common Acquisition Protocols For Scientific Studiesmentioning

confidence: 99%

“…The second metric for quantifying ERP data quality is called the standardized measurement error (SME), and it is an extension of the general concept of the standard error of measurement (Luck et al, 2021). The SME value for a given participant quantifies the precision of an ERP amplitude or latency score for that participant (i.e., the extent to which you would expect to obtain a similar score if you repeated the experiment multiple times for that participant).…”

Section: Quantifying Data Qualitymentioning

confidence: 99%

Good Scientific Practice in MEEG Research: Progress and Perspectives

Niso¹,

Krol²,

Combrisson³

et al. 2021

Preprint

View full text Add to dashboard Cite

Good Scientific Practice (GSP) refers to both explicit and implicit rules or guidelines that help scientists to produce work that is of the highest quality at any given time, and to efficiently share that work with the community for further scrutiny or utilization. For experimental research using magneto- and electroencephalography (MEEG), GSP includes specific standards and guidelines for technical competence, which are periodically updated whenever new findings come to light. However, GSP also needs to be periodically revisited in a broader light. At the LiveMEEG 2020 conference, a reflection on GSP was fostered that included explicitly documented guidelines and technical advances, but also emphasised intangible GSP: a general awareness of personal, organisational, and societal realities and how they can influence MEEG research. This article provides an extensive report on most of the LiveMEEG contributions and new literature, with the additional aim to synthesize ongoing cultural changes in GSP. It first covers GSP with respect to cognitive biases and logical fallacies, pre-registration as a tool to avoid those and other early pitfalls, and a number of resources to enable collaborative and reproducible research as a general approach to minimize misconceptions. Second, GSP with respect to data acquisition, analysis, reporting, and sharing is discussed, including new tools and frameworks to support collaborative work. Finally, GSP is considered in light of ethical implications of MEEG research and the resulting responsibility that scientists have to engage with societal challenges. Considering among other things the benefits of peer review and open access at all stages, the need to coordinate larger international projects, the complexity of MEEG subject matter, and today's prioritization of fairness, privacy, and the environment, we find that current GSP tends to favour collective and cooperative work, for both scientific and for societal reasons.

show abstract

“…The desired metric has to be sensitive to the typical sources of endogenous and exogenous noise in EEG recordings described above. While such a quantitative measure of EEG quality would arguably be a very practical tool, there is a striking shortage of proposed metrics in the literature and the ones established usually only target an expected evoked response rather than artefact pollution more generally (Luck, 2014;Luck et al, 2021;Picton, 2011;Wong & Bickford, 1980).…”

Section: Quantifying Eeg Data Qualitymentioning

confidence: 99%

Naturalistic viewing conditions can increase task engagement and aesthetic preference but have only minimal impact on EEG Quality

Welke

Vessel

2021

Preprint

View full text Add to dashboard Cite

Free gaze and the use of dynamically changing video stimuli are typically avoided in EEG exper- iments to avoid artefacts and confounds related to uncontrolled eye movements. Yet, often it is unclear whether these artificial secondary manipulations might have unwanted effects on the pri- mary measures of interest and for a growing number of research questions removing them would be beneficial: Among those is the investigation of visual aesthetic experiences, which typically involve open-ended exploration of highly variable stimuli. Here we aimed to quantify the effect of fixation task and using still vs. movie stimuli on EEG signal quality and several behavioral and physiological measures of interest during an aesthetic rating task. Participants observed scenes from landscapes and dance performances and rated each stimulus for both aesthetic appeal and their state of boredom while watching it. The scenes were presented either as dynamic video clips or static pictures, and participants observed them either with unconstrained gaze or under attempted fixation We recorded EEG, ECG and eyetracking from 43 participants. An auditory stream of 40Hz amplitude modulated pink noise was played during each trial and signal-to-noise-ratio (SNR) of the auditory steady-state response measured at the scalp was extracted as a proxy measure for overall EEG signal quality. The study including hypotheses and a priori power analysis was preregistered. We found that both behavioral ratings were influenced by the experimental conditions: boredom and aesthetic ratings were positively affected by dynamic video stimuli, indicating that these are experienced as more engaging; both these effects were stronger in dance. As already reported before, landscape stimuli were experienced as more appealing. Fixaton task, on the other hand, had no significant effect on the ratings which is encouraging given how canonically it is applied. Eye movements were significantly affected not only by viewing task, but by stimulus dynamics and content as well: we observed fewer eyeblinks, saccades and microsaccades in video stimuli, and fewer saccades but more microsaccades in dance than in landscape stimuli, with several significant interactions. EEG SNR, to our surprise, was barely affected by fixation task - despite only minimal preprocessing and no trial rejection. We nevertheless believe that the new metric is sensitive to capture noise: it was significantly correlated with the number of eye blinks, and after cleaning the dataset with an ICA based preprocessing pipeline the significant effect of fixation task and the correlation with blink rate vanished. We see these as promising results indicating that at least in the lab more liberal experimental conditions could be achieved without significant loss of signal quality. Specifically the use of dynamic video material bears a lot of potential for future investigations in human neurophysiological studies.

show abstract

Standardized measurement error: A universal metric of data quality for averaged event‐related potentials

Cited by 131 publications

References 26 publications

Assessing neuromodulation effects of theta burst stimulation to the prefrontal cortex using TMS-evoked potentials

Assessing neuromodulation effects of theta burst stimulation to the prefrontal cortex using TMS-evoked potentials

Good Scientific Practice in MEEG Research: Progress and Perspectives

Naturalistic viewing conditions can increase task engagement and aesthetic preference but have only minimal impact on EEG Quality

Contact Info

Product

Resources

About