Usability evaluation and adaptation of the e-health Personal Patient Profile-Prostate decision aid for Spanish-speaking Latino men

Abstract

BackgroundThe Personal Patient Profile-Prostate (P3P), a web-based decision aid, was demonstrated to reduce decisional conflict in English-speaking men with localized prostate cancer early after initial diagnosis. The purpose of this study was to explore and enhance usability and cultural appropriateness of a Spanish P3P by Latino men with a diagnosis of prostate cancer.MethodsP3P was translated to Spanish and back-translated by three native Spanish-speaking translators working independently. Spanish-speaking Latino men with a diagnosis of localized prostate cancer, who had made treatment decisions in the past 24 months, were recruited from two urban clinical care sites. Individual cognitive interviews were conducted by two bilingual research assistants as each participant used the Spanish P3P. Notes of user behavior, feedback, and answers to direct questions about comprehension, usability and perceived usefulness were analyzed and categorized.ResultsSeven participants with a range of education levels identified 25 unique usability issues in navigation, content comprehension and completeness, sociocultural appropriateness, and methodology. Revisions were prioritized to refine the usability and cultural and linguistic appropriateness of the decision aid.ConclusionsUsability issues were discovered that are potential barriers to effective decision support. Successful use of decision aids requires adaptation and testing beyond translation. Our findings led to revisions further refining the usability and linguistic and cultural appropriateness of Spanish P3P.

Translation and cultural adaptation of a prostate cancer screening decision aid: a qualitative study in Portugal

“…This is to our knowledge the first study to conduct cognitive interviews with men to adapt a prostate cancer screening decision aid after its translation. In terms of themes, our results are in line with similar studies conducted with cognitive interviews to evaluate decision aids for other preference-sensitive health decisions 36–38 43. Previous studies have shown that messages that do not clearly support cancer screening are seen as counterintuitive and that the benefits of screening are overestimated 44–46.…”

“…Guided by the theoretical framework, we conducted a thematic analysis approach to the qualitative data 34. A deductive approach was initially used to develop a categorisation matrix,35 in accordance with similar studies testing decision aids for other health-related decisions 36–39. Afterwards, data were analysed following the principles of inductive content analysis 35.…”

Health figures: an open source JavaScript library for health data visualization

“…We recruited a total of 14 participants following similar usability studies and Faulkner’s [ 67 ] recommendation of conducting usability tests with 10 to 20 users “in order to find 90 to 95 % of usability problems” [ 68 ]. Among the 14 participants we were able to recruit 3 usability experts, following the recommendations from Nielsen and a number of previous studies stating that 3 to 5 experts are needed to conduct the Heuristics Evaluation [ 35 , 36 , 69 – 72 ].…”

The Genomics ADvISER: development and usability testing of a decision aid for the selection of incidental sequencing results

“…The final version of the DA underwent usability testing through an iterative process [30], where feedback from participants in each cycle informed updates and modifications to the DA; the updated DA was then tested in the subsequent cycle. Usability testing is an established technique with the objective to systematically test the navigability and content comprehension of a tool prior to its distribution [31], and is commonly used in the development of DAs for health decisions [13,32,33]. Usability testing does not aim to validate tools for clinical use.…”