BackgroundConsistent healthcare decisionmaking requires systematic consideration of decision criteria and evidence available to inform them. This can be tackled by combining multicriteria decision analysis (MCDA) and Health Technology Assessment (HTA). The objective of this study was to field-test a decision support framework (EVIDEM), explore its utility to a drug advisory committee and test its reliability over time.MethodsTramadol for chronic non-cancer pain was selected by the health plan as a case study relevant to their context. Based on extensive literature review, a by-criterion HTA report was developed to provide synthesized evidence for each criterion of the framework (14 criteria for the MCDA Core Model and 6 qualitative criteria for the Contextual Tool). During workshop sessions, committee members tested the framework in three steps by assigning: 1) weights to each criterion of the MCDA Core Model representing individual perspective; 2) scores for tramadol for each criterion of the MCDA Core Model using synthesized data; and 3) qualitative impacts of criteria of the Contextual Tool on the appraisal. Utility and reliability of the approach were explored through discussion, survey and test-retest. Agreement between test and retest data was analyzed by calculating intra-rater correlation coefficients (ICCs) for weights, scores and MCDA value estimates.ResultsThe framework was found useful by the drug advisory committee in supporting systematic consideration of a broad range of criteria to promote a consistent approach to appraising healthcare interventions. Directly integrated in the framework as a "by-criterion" HTA report, synthesized evidence for each criterion facilitated its consideration, although this was sometimes limited by lack of relevant data. Test-retest analysis showed fair to good consistency of weights, scores and MCDA value estimates at the individual level (ICC ranging from 0.676 to 0.698), thus lending some support for the reliability of the approach. Overall, committee members endorsed the inclusion of most framework criteria and revealed important areas of discussion, clarification and adaptation of the framework to the needs of the committee.ConclusionsBy promoting systematic consideration of all decision criteria and the underlying evidence, the framework allows a consistent approach to appraising healthcare interventions. Further testing and validation are needed to advance MCDA approaches in healthcare decisionmaking.

BackgroundMRI-guided laser interstitial thermal therapy (MRgLITT) is a new minimally invasive treatment for temporal lobe epilepsy (TLE), with limited effectiveness data. It is unknown if the cost savings associated with shorter hospitalization could offset the high equipment cost of MRgLITT. We examined the cost-utility of MRgLITT versus surgery for TLE from healthcare payer perspective, and the value of additional research to inform policy decision on MRgLITT.MethodsWe developed a microsimulation model to evaluate quality adjusted life years (QALYs), costs, and incremental cost-effectiveness ratio (ICER) of MRgLITT versus surgery in TLE, assuming life-time horizon and 1.5% discount rate. Model inputs were derived from the literature. We conducted threshold and sensitivity analyses to examine parameter uncertainties, and expected value of partial perfect information analyses to evaluate the expected monetary benefit of eliminating uncertainty on probabilities associated with MRgLITT.ResultsMRgLITT yielded 0.08 more QALYs and cost $7,821 higher than surgery, with ICER of $94,350/QALY. Influential parameters that could change model outcomes include probabilities of becoming seizure-free from disabling seizures state and returning to disabling seizures from seizure-free state 5 years after surgery and MRgLITT, cost of MRgLITT disposable equipment, and utilities of disabling seizures and seizure-free states of surgery and MRgLITT. The cost-effectiveness acceptability curve showed surgery was preferred in more than 50% of iterations. The expected monetary benefit of eliminating uncertainty for probabilities associated with MRgLITT was higher than for utilities associated with MRgLITT.ConclusionsMRgLITT resulted in more QALYs gained and higher costs compared to surgery in the base-case. The model was sensitive to variations in the cost of MRgLITT disposable equipment. There is value in conducting more research to reduce uncertainty on the probabilities and utilities of MRgLITT, but priority should be given to research focusing on improving the precision of estimates on effectiveness of MRgLITT.

No abstract