Data Acquisition and Preprocessing in Studies on Humans: What is Not Taught in Statistics Classes?

Abstract

The aim of this paper is to address issues in research that may be missing from statistics classes and important for (bio-)statistics students. In the context of a case study, we discuss data acquisition and preprocessing steps that fill the gap between research questions posed by subject matter scientists and statistical methodology for formal inference. Issues include participant recruitment, data collection training and standardization, variable coding, data review and verification, data cleaning and editing, and documentation. Despite the critical importance of these details in research, most of these issues are rarely discussed in an applied statistics program. One reason for the lack of more formal training is the difficulty in addressing the many challenges that can possibly arise in the course of a study in a systematic way. This article can help to bridge this gap between research questions and formal statistical inference by using an illustrative case study for a discussion. We hope that reading and discussing this paper and practicing data preprocessing exercises will sensitize statistics students to these important issues and achieve optimal conduct, quality control, analysis, and interpretation of a study.

Longer breastfeeding duration reduces the positive relationships among gestational weight gain, birth weight and childhood anthropometrics

“…Data preprocessing approaches for this study were reported previously 23. Descriptive statistics of continuous or categorical maternal and child characteristics by GWG were presented as the mean (SD) or frequency, respectively.…”

Data Science in Statistics Curricula: Preparing Students to “Think with Data”

“…Whereas the first few aspects of carrying out an analysis have typically been skipped in too many traditional courses and curricula (Zhu, et al, 2013) , using a data centric approach requires students to follow the entire trajectory in order to understand the source and inherent variability of the data. Moreover, with a data science course it is possible to integrate statistical thinking with computing with experience with data --the goal is to focus on the computational problem solving aspects of carrying out a data analysis.…”

A Data Science Course for Undergraduates: Thinking With Data

“…(This is not to be confused with "statistical thinking" as articulated by Chance (2002), which contains no mention of computing.) In this case, a data habit of mind comes from experience working with data, and is manifest in people who start thinking about data formatting before data gets collected (Zhu et al, 2013), and have a foresight about how data should be stored that is informed by how it will be analyzed. Furthermore, while some might view data management as a perfunctory skill on intellectual par with data entry, there are others thinking more broadly about data.…”