Opportunities and Challenges of Web-Based and Remotely Administered Surveys for Patient Preference Studies in a Vulnerable Population

Oliveri, Serena; Lanzoni, Lucilla; Petrocchi, Serena; Janssens, Rik; Schoefs, Elise; Huys, Isabelle; Smith, Meredith Y.; Smith, I. P.; Veldwijk, Jorien; Wit, G. Ardine de; Pravettoni, Gabriella

doi:10.2147/ppa.s327006

Cited by 17 publications

(13 citation statements)

References 32 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Generalizability is also limited by the fact that the digital format of the survey may have discouraged those patients with lower digital literacy from participating as well as those who lack access to computer equipment or to the internet. 70 Third, the current study focused on medical decision making along the medical product life cycle, which did not include clinical or shared decision making. Because other outcome measures and potential methodological considerations might be important when selecting a preference method, the current findings might have limited generalizability toward those situations.…”

Section: Discussionmentioning

confidence: 99%

Comparing Discrete Choice Experiment with Swing Weighting to Estimate Attribute Relative Importance: A Case Study in Lung Cancer Patient Preferences

Veldwijk,

Smith,

Oliveri

et al. 2024

Med Decis Making

View full text Add to dashboard Cite

Introduction Discrete choice experiments (DCE) are commonly used to elicit patient preferences and to determine the relative importance of attributes but can be complex and costly to administer. Simpler methods that measure relative importance exist, such as swing weighting with direct rating (SW-DR), but there is little empirical evidence comparing the two. This study aimed to directly compare attribute relative importance rankings and weights elicited using a DCE and SW-DR. Methods A total of 307 patients with non–small-cell lung cancer in Italy and Belgium completed an online survey assessing preferences for cancer treatment using DCE and SW-DR. The relative importance of the attributes was determined using a random parameter logit model for the DCE and rank order centroid method (ROC) for SW-DR. Differences in relative importance ranking and weights between the methods were assessed using Cohen’s weighted kappa and Dirichlet regression. Feedback on ease of understanding and answering the 2 tasks was also collected. Results Most respondents (>65%) found both tasks (very) easy to understand and answer. The same attribute, survival, was ranked most important irrespective of the methods applied. The overall ranking of the attributes on an aggregate level differed significantly between DCE and SW-ROC ( P < 0.01). Greater differences in attribute weights between attributes were reported in DCE compared with SW-DR ( P < 0.01). Agreement between the individual-level attribute ranking across methods was moderate (weighted Kappa 0.53–0.55). Conclusion Significant differences in attribute importance between DCE and SW-DR were found. Respondents reported both methods being relatively easy to understand and answer. Further studies confirming these findings are warranted. Such studies will help to provide accurate guidance for methods selection when studying relative attribute importance across a wide array of preference-relevant decisions. Highlights Both DCEs and SW tasks can be used to determine attribute relative importance rankings and weights; however, little evidence exists empirically comparing these methods in terms of outcomes or respondent usability. Most respondents found the DCE and SW tasks very easy or easy to understand and answer. A direct comparison of DCE and SW found significant differences in attribute importance rankings and weights as well as a greater spread in the DCE-derived attribute relative importance weights.

show abstract

Section: Discussionmentioning

confidence: 99%

Comparing Discrete Choice Experiment with Swing Weighting to Estimate Attribute Relative Importance: A Case Study in Lung Cancer Patient Preferences

Veldwijk,

Smith,

Oliveri

et al. 2024

Med Decis Making

View full text Add to dashboard Cite

show abstract

“…Moreover, the multi-centric and multi-country nature of the research increases the generalizability of the results. Among several important advantages a web-based survey allowed us to include interactive educational videos, which provided instructions in plain language and offered another type of learning modality for participants ( Oliveri et al, 2021 ). This study also had some limitations.…”

Section: Discussionmentioning

confidence: 99%

“…Moreover, due to the SARS-CoV-2 pandemic, the original research protocol had to be adapted to a fully remote survey. While this had several advantages, including the possibility of reaching a wider and geographically distant population in a shorter timeframe and a reduced burden on the patients, it also carried some challenges which should be considered when conducting web-based preference studies ( Oliveri et al, 2021 ). In particular, dwelling on the number of patients who refused to participate in the study or dropped out, we notice that one-third from the Italian population were elder patients who struggled in using new technologies to complete the survey (a motivation also reported by Belgian patient population).…”

Section: Discussionmentioning

confidence: 99%

“…We pre-tested the survey with five patients in Italy, who completed a draft version of the survey at home on their personal computer or tablet, while communicating with the researcher via video-conferencing tools. Patients were instructed to verbalize any difficulty they encountered in completing the survey, including doubts, or obstacles they experienced in each section ( Oliveri et al, 2021 ). The researcher took notes and asked for clarifications when needed, then collected the patient’s overall impression of the survey.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Balancing benefits and risks in lung cancer therapies: patient preferences for lung cancer treatment alternatives

et al. 2023

Self Cite

View full text Add to dashboard Cite

BackgroundIn the treatment of Non-Small Cell Lung Cancer (NSCLC) the combination of Immuno- Oncotherapy (IO) and chemotherapy (CT) has been found to be superior to IO or CT alone for patients’ survival. Patients and clinicians are confronted with a preference sensitive choice between a more aggressive treatment with a greater negative effect on quality of life versus alternatives that are less effective but have fewer side effects.ObjectivesThe aims of this study were to: (a) quantify patients’ preferences for relevant attributes related to Immuno-Oncotherapy treatment alternatives, and (b) evaluate the maximum acceptable risk (MAR)/Minimum acceptable benefit (MAB) that patients would accept for treatment alternatives.MethodsAn online preference survey using discrete-choice experiment (DCE) was completed by NSCLC patients from two hospitals in Italy and Belgium. The survey asked patients’ preferences for five patient- relevant treatment attributes. The DCE was developed using a Bayesian D-efficient design. DCE analyses were performed using mixed logit models. Information regarding patient demographics, health literacy, locus of control, and quality of life was also collected.Results307 patients (158 Italian, 149 Belgian), stage I to IV, completed the survey. Patients preferred treatments with a higher 5-year survival chance as the most important attribute over all the other attributes. Preference heterogeneity for the attribute weights depended on health literacy, patients’ age and locus of control. Patients were willing to accept a substantially increased risks of developing side effects in exchange for the slightest increase (1%) in the chance of surviving at least 5 years from the diagnosis of cancer. Similarly, patients were willing to accept a switch in the mode of administration or complete loss of hair to obtain an increase in survival.ConclusionIn this study, the proportion of respondents who systematically preferred survival over all other treatment attributes was particularly high. Age, objective health literacy and locus of control accounted for heterogeneity in patients’ preferences. Evidence on how NSCLC patients trade between survival and other NSCLC attributes can support regulators and other stakeholders on assessing clinical trial evidence and protocols, based on patients’ conditions and socio-demographic parameters.

show abstract

“…Data collection for assessment and research is always an arduous and timeconsuming process. Therefore, in recent years the use of new technologies for data collection has proliferated [25,26]. There are platforms dedicated to online assessment, including MenPas 1.0 (www.menpas.com, accessed on 8 January 2021), which offers benefits, such as speed of assessment for both athletes and organizations and immediacy of the results, as well as being useful for obtaining databases for the instrument validation [25,27].…”

Section: Introductionmentioning

confidence: 99%

Testing the Psychometric Properties and Measurement Invariance of the Perceived Motivational Climate in Sport Questionnaire (PMCSQ-2): Online Assessment

Pérez-Romero,

Reigal,

Franquelo

et al. 2022

Sustainability

View full text Add to dashboard Cite

Athletes’ perception of competence and success can be influenced by the motivational climate created by the coach. The Perceived Motivational Climate in Sport Questionnaire (PMCSQ-2) assesses this. Although its reliability and validity have been analyzed in previous studies, this has never been done for the online version. This type of evaluation can be beneficial for data collection, sustainability, speed, and generating larger samples. Therefore, the aim of this study is to analyze the psychometric properties of the PMCSQ-2 in its online version. The sample consisted of 1637 participants (37.8% men and 62.2% women) from 18 to 68 years of age (M = 24.39, SD = 6.51) who practiced physical-sport activities regularly. A second-order confirmatory factor analysis (CFA) model and its invariance for gender were studied from a 24-item version obtained from the MenPas 1.0 platform. The analyses provided an adequate fit for the CFA (CFI = 0.91, TLI = 0.90, RMSEA = 0.07, SRMR = 0.07, df = 224, B-S p = 0.02–0.07) when an alternative model was realized (χ2 = 1858.89, χ2/df = 8.30), as they also did for the women (χ2 = 1356.90, χ2/df = 6.06), men (χ2 = 883.58, χ2/df = 3.95) individual sports (χ2 = 1153.55, χ2/df = 5.15), and team sports (χ2 = 1008.92, χ2/df = 4.05) items. The data were also suitable for invariance analysis. Similarly, appropriate values were obtained for convergent and discriminant validity and for composite reliability. Therefore, the results obtained show appropriate psychometric properties for the online version of the PMCSQ-2 using an alternative model, suggesting that its use is suitable for research and showing the importance of the subscales.

show abstract

Opportunities and Challenges of Web-Based and Remotely Administered Surveys for Patient Preference Studies in a Vulnerable Population

Cited by 17 publications

References 32 publications

Comparing Discrete Choice Experiment with Swing Weighting to Estimate Attribute Relative Importance: A Case Study in Lung Cancer Patient Preferences

Comparing Discrete Choice Experiment with Swing Weighting to Estimate Attribute Relative Importance: A Case Study in Lung Cancer Patient Preferences

Balancing benefits and risks in lung cancer therapies: patient preferences for lung cancer treatment alternatives

Testing the Psychometric Properties and Measurement Invariance of the Perceived Motivational Climate in Sport Questionnaire (PMCSQ-2): Online Assessment

Contact Info

Product

Resources

About