Comparing Methods for Measurement Error Detection in Serial 24-h Hormonal Data

Abstract

Measurement errors commonly occur in 24-h hormonal data and may affect the outcomes of such studies. Measurement errors often appear as outliers in such data sets; however, no well-established method is available for their automatic detection. In this study, we aimed to compare performances of different methods for outlier detection in hormonal serial data. Hormones (glucose, insulin, thyroid-stimulating hormone, cortisol, and growth hormone) were measured in blood sampled every 10 min for 24 h in 38 participants of the Leiden Longevity Study. Four methods for detecting outliers were compared: (1) eyeballing, (2) Tukey’s fences, (3) stepwise approach, and (4) the expectation-maximization (EM) algorithm. Eyeballing detects outliers based on experts’ knowledge, and the stepwise approach incorporates physiological knowledge with a statistical algorithm. Tukey’s fences and the EM algorithm are data-driven methods, using interquartile range and a mathematical algorithm to identify the underlying distribution, respectively. The performance of the methods was evaluated based on the number of outliers detected and the change in statistical outcomes after removing detected outliers. Eyeballing resulted in the lowest number of outliers detected (1.0% of all data points), followed by Tukey’s fences (2.3%), the stepwise approach (2.7%), and the EM algorithm (11.0%). In all methods, the mean hormone levels did not change materially after removing outliers. However, their minima were affected by outlier removal. Although removing outliers affected the correlation between glucose and insulin on the individual level, when averaged over all participants, none of the 4 methods influenced the correlation. Based on our results, the EM algorithm is not recommended given the high number of outliers detected, even where data points are physiologically plausible. Since Tukey’s fences is not suitable for all types of data and eyeballing is time-consuming, we recommend the stepwise approach for outlier detection, which combines physiological knowledge and an automated process.

Impulsive time series modeling with application to luteinizing hormone data

“…One outlier was removed from one data set as its implausibly low value interfered with establishing the basal level. There exist outlier detection methods that can be applied to hormonal data ( 26 ), but they are typically not adapted to the pulsatile nature of the signals, thus limiting their utility. In our case, the outlier was detected through visual inspection of the data.…”

Effects of Paired Associative Stimulation on Cortical Plasticity in Agonist–Antagonist Muscle Representations

“…The outliers of the peak-to-peak MEP amplitudes were checked using Tukey’s fences, and values greater than 1.5 times the interquartile range of each participant’s initial dataset were excluded from the initial datasets [ 59 ]. The blank cells removed by the outliers were linearly interpolated.…”

Nonequivalent After-Effects of Alternating Current Stimulation on Motor Cortex Oscillation and Inhibition: Simulation and Experimental Study

“…A previous study [ 47 ] noted that MEP amplitudes randomly fluctuate between stimuli. Therefore, peak-to-peak MEP amplitudes were evaluated for the existence of outliers through Tukey’s fences, with values more than 1.5 times that of the interquartile range excluded from the datasets [ 48 ]. To increase the precision of level and slope estimations of cortical inhibition, the blank cells produced by removing the outliers were then linearly interpolated.…”