Turning the Page on Pen-and-Paper Questionnaires: Combining Ecological Momentary Assessment and Computer Adaptive Testing to Transform Psychological Assessment in the 21st Century

Gibbons, Christopher

doi:10.3389/fpsyg.2016.01933

Cited by 20 publications

(20 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…4 Furthermore, unlike other areas of medicine, psychiatry is highly dependent on patient/family reports to assess the presence and severity of disease. 5 Not only the experience of a subjective event such as psychopathological phenomena but also the recollection, report, and interpretation by the rater of such an experience can be subject to multiple biases. 6 Hence, achieving further objectification has become a challenge and a goal for evidence-based mental health research.…”

Section: Introductionmentioning

confidence: 99%

Development and Validation of a Computerized Adaptive Assessment Tool for Discrimination and Measurement of Psychotic Symptoms

Guinart

Filippis

Rosson

et al. 2020

Schizophrenia Bulletin

View full text Add to dashboard Cite

Objective Time constraints limit the use of measurement-based approaches in research and routine clinical management of psychosis. Computerized adaptive testing (CAT) can reduce administration time, thus increasing measurement efficiency. This study aimed to develop and test the capacity of the CAT-Psychosis battery, both self-administered and rater-administered, to measure the severity of psychotic symptoms and discriminate psychosis from healthy controls. Methods An item bank was developed and calibrated. Two raters administered CAT-Psychosis for inter-rater reliability (IRR). Subjects rated themselves and were retested within 7 days for test-retest reliability. The Brief Psychiatric Rating Scale (BPRS) was administered for convergent validity and chart diagnosis, and the Structured Clinical Interview (SCID) was used to test psychosis discriminant validity. Results Development and calibration study included 649 psychotic patients. Simulations revealed a correlation of r = .92 with the total 73-item bank score, using an average of 12 items. Validation study included 160 additional patients and 40 healthy controls. CAT-Psychosis showed convergent validity (clinician: r = 0.690; 95% confidence interval [95% CI]: 0.610–0.757; self-report: r = .690; 95% CI: 0.609–0.756), IRR (intraclass correlation coefficient [ICC] = 0.733; 95% CI: 0.611–0.828), and test-retest reliability (clinician ICC = 0.862; 95% CI: 0.767–0.922; self-report ICC = 0.815; 95%CI: 0.741–0.871). CAT-Psychosis could discriminate psychosis from healthy controls (clinician: area under the receiver operating characteristic curve [AUC] = 0.965, 95% CI: 0.945–0.984; self-report AUC = 0.850, 95% CI: 0.807–0.894). The median length of the clinician-administered assessment was 5 minutes (interquartile range [IQR]: 3:23–8:29 min) and 1 minute, 20 seconds (IQR: 0:57–2:09 min) for the self-report. Conclusion CAT-Psychosis can quickly and reliably assess the severity of psychosis and discriminate psychotic patients from healthy controls, creating an opportunity for frequent remote assessment and patient/population-level follow-up.

show abstract

Section: Introductionmentioning

confidence: 99%

Development and Validation of a Computerized Adaptive Assessment Tool for Discrimination and Measurement of Psychotic Symptoms

Guinart

Filippis

Rosson

et al. 2020

Schizophrenia Bulletin

View full text Add to dashboard Cite

show abstract

“…On average, the randomly selected participants reported consuming 23 oz of wine during the period prior to the intervention. This process in which participants must report their behavior in real time and context is called Momentary Ecological Evaluation (Stone and Shiffman, 1994; Gibbons, 2017).…”

Section: Methodsmentioning

confidence: 99%

The Impact of the Content of the Label on the Buying Intention of a Wine Consumer

Escandón-Barbosa

Criado

2019

Front. Psychol.

View full text Add to dashboard Cite

This paper aims to analyze the influence of the content of the label of wine bottles on the purchase intention of wine. The sample was 114 individuals (51, 32% women and 48, 67% men) inside simulated Supermarket at Javeriana University of the city of Cali (Colombia). They were viewed for 2 min in front of a grocery shelving with 100 wines. The study uses eye tracking to estimate the behavior related to wine attributes included on the label of wine bottles, specifically the denomination of origin, nutritional information, and health warnings. The authors use the hierarchical model methodology, which generates a pattern of relationships among variables. Among the results, it is possible to determine a consistent model for purchase intention, where the mentioned components of the label that are related to wine attributes and their interactions constitute important factors in the possibility of influencing a purchase intention. However, when executing a group division of the audience attending to the experience in wine consumption, it is evident that based on their experience, consumers read the labels’ information differently, causing certain effects in their buying intention.

show abstract

“…Even when correct methods to evaluating reliability are used, there are still challenges to obtaining adequate reliability for some types of measures. Given the time burden imposed on participants in research designs requiring multiple assessments over days or weeks, the number of self-report items administered for a scale or trials administered on a cognitive measure are fewer than is typical in laboratory settings (e.g., Gibbons, 2017; Sliwinski et al, 2018). These abbreviated assessments may be more prone to measurement error than traditional measures.…”

Section: Reliability Of Self-report Measuresmentioning

confidence: 99%

Practical considerations for evaluating reliability in ambulatory assessment studies.

Calamia

2019

Psychological Assessment

View full text Add to dashboard Cite

Ambulatory assessment studies have unique challenges related to obtaining adequate reliability relative to other types of research designs. For example, because of time constraints, limitations in the number of items administered at each occasion can negatively affect the reliable assessment of within-person change. Whereas some types of measures, such as objective measures of physical activity, have been the focus of a cumulative body of reliability research, a lack of reporting of reliability data for cognitive and self-report measures in many studies is a significant barrier for researchers who want to choose measures based on prior psychometric research. Several approaches to assessing the reliability of ambulatory assessment data are available, and further research with less widely used reliability metrics (e.g., stability in within-person variability across time) is warranted. Given the time and effort involved in conducting ambulatory assessment studies, proper consideration of reliability is needed so that researchers have sufficient power to take advantage of the large amount of data often available within a single ambulatory assessment study.

show abstract

Turning the Page on Pen-and-Paper Questionnaires: Combining Ecological Momentary Assessment and Computer Adaptive Testing to Transform Psychological Assessment in the 21st Century

Cited by 20 publications

References 15 publications

Development and Validation of a Computerized Adaptive Assessment Tool for Discrimination and Measurement of Psychotic Symptoms

Development and Validation of a Computerized Adaptive Assessment Tool for Discrimination and Measurement of Psychotic Symptoms

The Impact of the Content of the Label on the Buying Intention of a Wine Consumer

Practical considerations for evaluating reliability in ambulatory assessment studies.

Contact Info

Product

Resources

About