Paper Versus Digital Data Collection Methods for Road Safety Observations: Comparative Efficiency Analysis of Cost, Timeliness, Reliability, and Results

Abstract

Background Roadside observational studies play a fundamental role in designing evidence-informed strategies to address the pressing global health problem of road traffic injuries. Paper-based data collection has been the standard method for such studies, although digital methods are gaining popularity in all types of primary data collection. Objective This study aims to understand the reliability, productivity, and efficiency of paper vs digital data collection based on three different road user behaviors: helmet use, seatbelt use, and speeding. It also aims to understand the cost and time efficiency of each method and to evaluate potential trade-offs among reliability, productivity, and efficiency. Methods A total of 150 observational sessions were conducted simultaneously for each risk factor in Mumbai, India, across two rounds of data collection. We matched the simultaneous digital and paper observation periods by date, time, and location, and compared the reliability by subgroups and the productivity using Pearson correlations (r). We also conducted logistic regressions separately by method to understand how similar results of inferential analyses would be. The time to complete an observation and the time to obtain a complete dataset were also compared, as were the total costs in US dollars for fieldwork, data entry, management, and cleaning. Results Productivity was higher in paper than digital methods in each round for each risk factor. However, the sample sizes across both methods provided a precision of 0.7 percentage points or smaller. The gap between digital and paper data collection productivity narrowed across rounds, with correlations improving from r=0.27-0.49 to 0.89-0.96. Reliability in risk factor proportions was between 0.61 and 0.99, improving between the two rounds for each risk factor. The results of the logistic regressions were also largely comparable between the two methods. Differences in regression results were largely attributable to small sample sizes in some variable levels or random error in variables where the prevalence of the outcome was similar among variable levels. Although data collectors were able to complete an observation using paper more quickly, the digital dataset was available approximately 9 days sooner. Although fixed costs were higher for digital data collection, variable costs were much lower, resulting in a 7.73% (US $3011/38,947) lower overall cost. Conclusions Our study did not face trade-offs among time efficiency, cost efficiency, statistical reliability, and descriptive comparability when deciding between digital and paper, as digital data collection proved equivalent or superior on these domains in the context of our project. As trade-offs among cost, timeliness, and comparability—and the relative importance of each—could be unique to every data collection project, researchers should carefully consider the questionnaire complexity, target sample size, implementation plan, cost and logistical constraints, and geographical contexts when making the decision between digital and paper.

The National Danish Cardiac Arrest Registry for Out-of-Hospital Cardiac Arrest – A Registry in Transformation

“…Other registries have undergone the development from paper to electronic records similar to the DCAR has with the same success 16,17 In 2016 the validation of data became more substantial and additional variables were added. Survival after 30 days has increased throughout the years along with the rising incidence of OHCA, and in 2018, the 30-day survival following OHCA was 16%.…”

HRQoL and nutritional well-being dissimilarities between two different online collection methods: Value for digital health implementation

“…14 Online surveys have the advantages of being a quick and economic response instrument, with a wide geographical reach, which may increase the feasibility of health-related studies. 14,16,47,48 Thus, in a 10-year prospective cohort study, it has been found that the web-based version of data collection does not imply a loss in data quality. 49 Furthermore, the webbased questionnaires were completed to a greater extent and with less missing data than paper-based ones.…”

“…78,79 Comparison with prior work One of the biggest difficulties concerning these analyses was finding comparable studies. Most web-based studies available are based on dietary and physical activity interventions for weight loss primarily, [80][81][82] Literature shows articles comparing web-based with non-web-based, 13,47,49 physical, 15 telephone, mailing 83 or postal 14 data collection. Other study compared the characteristics of a sample of pregnant smokers, recruited through four different online platforms (three crowdsourcing platforms and one social media site) and describes the differences and feasibility of each platform as well as the costs per completed survey.…”

Introducing field digital data collection systems into seasonal malaria chemoprevention campaigns: opportunities for robust evidence development and national e-health strategies

“…Taber et al for instance support this point and note that although the fixed costs for DDC were higher, the variable costs were much lower than for PBDC, resulting in a 7.73% lower overall cost. 28 Njuguna et al also indicate in their study on the cost-effectiveness of digital-based applications that during their establishment, the cost of DDCs was 9.4% higher than that of PPDC. However, after 2 years, DDC costs decreased by 7%, compared with PPDC.…”