In 1999, ISPOR formed the Quality of Life Special Interest group (QoL-SIG)--Translation and Cultural Adaptation group (TCA group) to stimulate discussion on and create guidelines and standards for the translation and cultural adaptation of patient-reported outcome (PRO) measures. After identifying a general lack of consistency in current methods and published guidelines, the TCA group saw a need to develop a holistic perspective that synthesized the full spectrum of published methods. This process resulted in the development of Translation and Cultural Adaptation of Patient Reported Outcomes Measures--Principles of Good Practice (PGP), a report on current methods, and an appraisal of their strengths and weaknesses. The TCA Group undertook a review of evidence from current practice, a review of the literature and existing guidelines, and consideration of the issues facing the pharmaceutical industry, regulators, and the broader outcomes research community. Each approach to translation and cultural adaptation was considered systematically in terms of rationale, components, key actors, and the potential benefits and risks associated with each approach and step. The results of this review were subjected to discussion and challenge within the TCA group, as well as consultation with the outcomes research community at large. Through this review, a consensus emerged on a broad approach, along with a detailed critique of the strengths and weaknesses of the differing methodologies. The results of this review are set out as "Translation and Cultural Adaptation of Patient Reported Outcomes Measures--Principles of Good Practice" and are reported in this document.
The FACIT (Functional Assessment of Chronic Illness Therapy) translation methodology has been in use for nearly 10 years and, during the course of that time, has emphasized a universal translation approach that includes multicountry review, the use of qualitative and quantitative methods in testing, and the exploration of new methods such as differential item functioning (DIF) analysis using item response theory to evaluate item equivalence. The FACIT translation methodology aims to establish equivalence of meaning and measurement between different country versions through the use of the decentered model of translation and advanced statistical methods.
It is hoped that this report and the decision tools proposed will assist those involved with multinational trials to 1) decide on the translations required for each country; 2) choose the approach to use when the same language is spoken in more than one country; and 3) choose methods to gather evidence to support the pooling of data collected using different language versions of the same tool.
Patient-reported outcomes (PROs) are an important means of evaluating the treatment benefit of new medical products. It is recognized that PRO measures should be used when assessing concepts best known by the patient or best measured from the patient’s perspective. As a result, there is growing emphasis on well defined and reliable PRO measures. In addition, advances in technology have significantly increased electronic PRO (ePRO) data collection capabilities and options in clinical trials. The movement from paper-based to ePRO data capture has enhanced the integrity and accuracy of clinical trial data and is encouraged by regulators. A primary distinction in the types of ePRO platforms is between telephone-based interactive voice response systems and screen-based systems. Handheld touchscreen-based devices have become the mainstay for remote (i.e., off-site, unsupervised) PRO data collection in clinical trials. The conventional approach is to provide study subjects with a handheld device with a device-based proprietary software program. However, an emerging alternative for clinical trials is called bring your own device (BYOD). Leveraging study subjects’ own Internet-enabled mobile devices for remote PRO data collection (via a downloadable app or a Web-based data collection portal) has become possible due to the widespread use of personal smartphones and tablets. However, there are a number of scientific and operational issues that must be addressed before BYOD can be routinely considered as a practical alternative to conventional ePRO data collection methods. Nevertheless, the future for ePRO data collection is bright and the promise of BYOD opens a new chapter in its evolution.
Purpose
The US Food and Drug Administration (FDA) 2009 guidance for industry on patient-reported outcome (PRO) measures describes how the Agency evaluates the psychometric properties of measures intended to support medical product labeling claims. An important psychometric property is test–retest reliability. The guidance lists intraclass correlation coefficients (ICCs) and the assessment time period as key considerations for test–retest reliability evaluations. However, the guidance does not provide recommendations regarding ICC computation, nor is there consensus within the measurement literature regarding the most appropriate ICC formula for test–retest reliability assessment. This absence of consensus emerged as an issue within Critical Path Institute’s PRO Consortium. The purpose of this project was to generate thoughtful and informed recommendations regarding the most appropriate ICC formula for assessing a PRO measure’s test–retest reliability.
Methods
Literature was reviewed and a preferred ICC formula was proposed. Feedback on the chosen formula was solicited from psychometricians, biostatisticians, regulators, and other scientists who have collaborated on PRO Consortium initiatives.
Results and conclusions
Feedback was carefully considered and, after further deliberation, the proposed ICC formula was confirmed. In conclusion, to assess test–retest reliability for PRO measures, the two-way mixed-effect analysis of variance model with interaction for the absolute agreement between single scores is recommended.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.