Validation of Web-Based Physical Activity Measurement Systems Using Doubly Labeled Water

Abstract

BackgroundOnline or Web-based measurement systems have been proposed as convenient methods for collecting physical activity data. We developed two Web-based physical activity systems—the 24-hour Physical Activity Record Web (24hPAR WEB) and 7 days Recall Web (7daysRecall WEB).ObjectiveTo examine the validity of two Web-based physical activity measurement systems using the doubly labeled water (DLW) method.MethodsWe assessed the validity of the 24hPAR WEB and 7daysRecall WEB in 20 individuals, aged 25 to 61 years. The order of email distribution and subsequent completion of the two Web-based measurements systems was randomized. Each measurement tool was used for a week. The participants’ activity energy expenditure (AEE) and total energy expenditure (TEE) were assessed over each week using the DLW method and compared with the respective energy expenditures estimated using the Web-based systems.ResultsThe mean AEE was 3.90 (SD 1.43) MJ estimated using the 24hPAR WEB and 3.67 (SD 1.48) MJ measured by the DLW method. The Pearson correlation for AEE between the two methods was r = .679 (P < .001). The Bland-Altman 95% limits of agreement ranged from –2.10 to 2.57 MJ between the two methods. The Pearson correlation for TEE between the two methods was r = .874 (P < .001). The mean AEE was 4.29 (SD 1.94) MJ using the 7daysRecall WEB and 3.80 (SD 1.36) MJ by the DLW method. The Pearson correlation for AEE between the two methods was r = .144 (P = .54). The Bland-Altman 95% limits of agreement ranged from –3.83 to 4.81 MJ between the two methods. The Pearson correlation for TEE between the two methods was r = .590 (P = .006). The average input times using terminal devices were 8 minutes and 10 seconds for the 24hPAR WEB and 6 minutes and 38 seconds for the 7daysRecall WEB.ConclusionsBoth Web-based systems were found to be effective methods for collecting physical activity data and are appropriate for use in epidemiological studies. Because the measurement accuracy of the 24hPAR WEB was moderate to high, it could be suitable for evaluating the effect of interventions on individuals as well as for examining physical activity behavior.

The Comparative Validity of Interactive Multimedia Questionnaires to Paper-Administered Questionnaires for Beverage Intake and Physical Activity: Pilot Study

“…One assesses habitual beverage intake (BEVQ-15) [18], and the other measures usual physical activity level, Stanford Leisure-Time Activity Categorical Item 2.2 (L-Cat) [19]. There are several computerized nutrition education delivery [7,20,21] and dietary assessment tools [8,13,22-28] and a few Web-based physical activity questionnaires [12,29,30] currently available; however, to the best of our knowledge, no computer-based beverage intake questionnaire exists. The recently developed Automated Self-Administered 24-hour Recall [31] is computer-based and does contain questions about beverage intake; however, results on its validity and usability have yet to be published [32].…”

Design and Evaluation of a Computer-Based 24-Hour Physical Activity Recall (cpar24) Instrument

“…Similarly, there appeared to be less variation across accuracy estimates of total energy expenditure than physical activity energy expenditure for both methods when using doubly-labeled water as the gold standard (total energy expenditure from short-term physical activity recalls [7,32-35,37-39,42-48]: mean percent difference=7%, range=−27%-37%; total energy expenditure from accelerometry [40]: mean percent difference=−12%, range=−22%-1%; physical activity energy expenditure from short-term physical activity recalls [7,38,39,41,48,49]: mean percent difference=20%, range=−20%-113%; physical activity energy expenditure from accelerometry [40]: mean percent difference=−24%, range=−59%-40%). However, accelerometry tended to underestimate energy expenditure, whereas short-term physical activity recalls tended to overestimate energy expenditure.…”

Web-Based Assessments of Physical Activity in Youth: Considerations for Design and Scale Calibration

“…Although the calibration principles described here are specific for the YAP, the concepts and methods may have utility for researchers interested in similar calibration work with other tools or Web-based applications. There is an increased interest in Web applications of physical activity surveys [ 14 - 17 , 19 , 84 ]; however, to our knowledge no research has described a systematic process to develop, calibrate, and disseminate the use of such assessments.…”