Assessing the Equivalence of Paper, Mobile Phone, and Tablet Survey Responses at a Community Mental Health Center Using Equivalent Halves of a ‘Gold-Standard’ Depression Item Bank

Brodey, Benjamin B.; Gonzalez, Nicole; Elkin, Kathryn Ann; Sasiela, William J.; Brodey, Inger Sigrun

doi:10.2196/mental.6805

Cited by 11 publications

(7 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, although one recent study did find that the method of survey administration has a clinically significant effect on the measurement of PROMIS UE scores, 42 numerous studies of a variety of PROMIS instruments found no such difference. 5 , 7 , 22 Another limitation of the present study is the mean follow-up period of 472 days. A study with a shorter or longer mean follow-up period may yield different results, due to both the longitudinal changes in subjects’ physical function after surgery as well as the increase in recall bias inherent to longer follow-up periods in anchor-based MCID calculations.…”

Section: Discussionmentioning

confidence: 92%

Minimal clinically important difference, substantial clinical benefit, and patient acceptable symptom state of PROMIS upper extremity after total shoulder arthroplasty

et al. 2021

View full text Add to dashboard Cite

Background The Patient-Reported Outcomes Measurement Information System minimal clinically important difference (PROMIS MCID), substantial clinical benefit (SCB), and patient acceptable symptom state (PASS) of patient-reported outcome measures provide clinical significance to patient-reported outcome measures scores. The goal of this study is to measure the MCID, SCB, and PASS of PROMIS Upper Extremity v2.0 (PROMIS UE) in patients undergoing total shoulder arthroplasty (TSA). Methods All patients who underwent TSA since October 2017 were identified from our institutional database. Patients who had completed the PROMIS UE outcome measure before surgery were asked to complete a PROMIS UE and anchor survey that contained two transition questions to assess patient satisfaction and change in symptoms since treatment. The anchor-based MCID, SCB, and PASS were calculated as the change in PROMIS UE score that represented the optimal cutoff for a receiver operating characteristic curve. The distribution-based MCID was calculated as a range between the average standard error of measurement multiplied by 2 different constants: 1 and 2.77. Results This study enrolled 165 patients. The anchor-based MCID for PROMIS UE was calculated to be 8.05 with an AUC of 0.814. The anchor-based SCB was calculated to be 10.0 with an AUC of 0.727. The distribution-based MCID was calculated to be between 3.12 and 8.65. The PASS was calculated to be 37.2 with an AUC of 0.90. Conclusions The establishment of MCID, SCB, and PASS for PROMIS UE scores after shoulder arthroplasty provides meaningful and objective clinical interpretation of the improvements in outcome scores after TSA.

show abstract

Section: Discussionmentioning

confidence: 92%

Minimal clinically important difference, substantial clinical benefit, and patient acceptable symptom state of PROMIS upper extremity after total shoulder arthroplasty

et al. 2021

View full text Add to dashboard Cite

show abstract

“…In this study, the washout period was 2 hours. In addition, some researchers have tried new methods to overcome these challenges, such as creating two functionally equivalent halves of the item bank [ 33 ]. However, for the ASES questionnaire, there are relatively few items, and each item evaluates a specific functional direction, so this method cannot be adopted.…”

Section: Discussionmentioning

confidence: 99%

Validation of a Mobile Version of the American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form: An Observational Randomized Crossover Trial

Hou¹,

Li²,

Yu³

et al. 2020

JMIR Mhealth Uhealth

View full text Add to dashboard Cite

Background The American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form (ASES) questionnaire is an effective tool for evaluating shoulder joint function. The development and usage of a mobile version of the ASES questionnaire has the potential to save time, money, and effort. Objective The aim of this study is to assess the equivalence between the paper and mobile versions of the ASES questionnaire and their acceptability among patients. Methods The paper and mobile versions of the ASES questionnaire were used to evaluate the shoulder joint function of 50 patients with shoulder pain. This study included patients from the shoulder clinic of Sun Yat-sen Memorial Hospital. The intraclass correlation coefficient (ICC) and Bland-Altman method were used to evaluate the agreement (reliability) of the scores obtained by the two methods (paper versus mobile). Results Of the 50 patients recruited from March 2018 to May 2019, 46 (92%) completed the study. There was a high agreement between the paper and mobile versions of the ASES questionnaire (ICC=0.979, 95% CI 0.943-0.987; P<.001). The mean difference between the scores of the mobile and paper versions was 1.0, and only 1/46 (2%) had a difference greater than the minimal clinically important difference of 12 points. About 75% of patients preferred the mobile version to the paper version. Conclusions Our study shows that the mobile version of the ASES questionnaire is comparable to the paper version, and has a higher patient preference. This could prove to be a useful tool for epidemiological studies and patient follow-up over longer periods of time.

show abstract

“…In fact, one study found that text message responses from participants were more candid than responses from voice interviews [ 18 ]. Text message surveys yield data that are comparable with other paper and online assessment tools [ 19 , 20 ], while overcoming many of the limitations of these traditional approaches (ie, interviews, computer-assisted surveys, and school-based assessments) [ 4 , 7 , 21 , 22 ]. For example, real-time text message data can reduce recall biases inherent in costly assessments that may be several months or years apart [ 5 , 23 ].…”

Section: Introductionmentioning

confidence: 99%

Feasibility of Assessing Economic and Sexual Risk Behaviors Using Text Message Surveys in African-American Young Adults Experiencing Homelessness and Unemployment: Single-Group Study

Mayo-Wilson¹,

Glass²,

Labrique³

et al. 2020

JMIR Form Res

View full text Add to dashboard Cite

Background Text messages offer the potential to better evaluate HIV behavioral interventions using repeated longitudinal measures at a lower cost and research burden. However, they have been underused in US minority settings. Objective This study aims to examine the feasibility of assessing economic and sexual risk behaviors using text message surveys. Methods We conducted a single-group study with 17 African-American young adults, aged 18-24 years, who were economically disadvantaged and reported prior unprotected sex. Participants received a text message survey once each week for 5 weeks. The survey contained 14 questions with yes-no and numeric responses on sexual risk behaviors (ie, condomless sex, sex while high or drunk, and sex exchange) and economic behaviors (ie, income, employment, and money spent on HIV services or products). Feasibility measures were the number of participants who responded to the survey in a given week, the number of questions to which a participant responded in each survey, and the number of hours spent from sending a survey to participants to receiving their response in a given week. One discussion group was used to obtain feedback. Results Overall, 65% (n=11/17) of the participants responded to at least one text message survey compared with 35% (n=6/17) of the participants who did not respond. The majority (n=7/11, 64%) of the responders were women. The majority (n=4/6, 67%) of nonresponders were men. An average of 7.6 participants (69%) responded in a given week. Response rates among ever responders ranged from 64% to 82% across the study period. The mean number of questions answered each week was 12.6 (SD 2.7; 90% of all questions), ranging from 72% to 100%. An average of 6.4 participants (84%) answered all 14 text message questions in a given week, ranging from 57% to 100%. Participants responded approximately 8.7 hours (SD 10.3) after receiving the survey. Participants were more likely to answer questions related to employment, condomless sex, and discussions with sex partners. Nonresponse or skip was more often used for questions at the end of the survey relating to sex exchange and money spent on HIV prevention services or products. Strengths of the text message survey were convenience, readability, short completion time, having repeated measures over time, and having incentives. Conclusions Longitudinal text message surveys may be a valuable tool for assessing HIV-related economic and sexual risk behaviors. Trial Registration ClinicalTrials.gov NCT03237871; https://clinicaltrials.gov/ct2/show/NCT03237871

show abstract

Assessing the Equivalence of Paper, Mobile Phone, and Tablet Survey Responses at a Community Mental Health Center Using Equivalent Halves of a ‘Gold-Standard’ Depression Item Bank

Cited by 11 publications

References 17 publications

Minimal clinically important difference, substantial clinical benefit, and patient acceptable symptom state of PROMIS upper extremity after total shoulder arthroplasty

Minimal clinically important difference, substantial clinical benefit, and patient acceptable symptom state of PROMIS upper extremity after total shoulder arthroplasty

Validation of a Mobile Version of the American Shoulder and Elbow Surgeons Standardized Shoulder Assessment Form: An Observational Randomized Crossover Trial

Feasibility of Assessing Economic and Sexual Risk Behaviors Using Text Message Surveys in African-American Young Adults Experiencing Homelessness and Unemployment: Single-Group Study

Contact Info

Product

Resources

About