The Impact of Outliers on Net-Benefit Regression Model in Cost-Effectiveness Analysis

Abstract

Ordinary least square (OLS) in regression has been widely used to analyze patient-level data in cost-effectiveness analysis (CEA). However, the estimates, inference and decision making in the economic evaluation based on OLS estimation may be biased by the presence of outliers. Instead, robust estimation can remain unaffected and provide result which is resistant to outliers. The objective of this study is to explore the impact of outliers on net-benefit regression (NBR) in CEA using OLS and to propose a potential solution by using robust estimations, i.e. Huber M-estimation, Hampel M-estimation, Tukey's bisquare M-estimation, MM-estimation and least trimming square estimation. Simulations under different outlier-generating scenarios and an empirical example were used to obtain the regression estimates of NBR by OLS and five robust estimations. Empirical size and empirical power of both OLS and robust estimations were then compared in the context of hypothesis testing.Simulations showed that the five robust approaches compared with OLS estimation led to lower empirical sizes and achieved higher empirical powers in testing cost-effectiveness. Using real example of antiplatelet therapy, the estimated incremental net-benefit by OLS estimation was lower than those by robust approaches because of outliers in cost data. Robust estimations demonstrated higher probability of cost-effectiveness compared to OLS estimation. The presence of outliers can bias the results of NBR and its interpretations. It is recommended that the use of robust estimation in NBR can be an appropriate method to avoid such biased decision making.

Cost-Effectiveness of Dementia Care Mapping in Care-Home Settings: Evaluation of a Randomised Controlled Trial

“…Given this, there was no reasonable justification for removing these individuals from the main analyses. While some consideration has been given to the impact of high-cost individuals [40], further research is needed on this topic. Additional information on the cause of secondary-care resource use may be useful since this often drives overall costs.…”

Parametric cost-effectiveness inference with skewed data

“…It has been noted that inference concerning ICER and INB can be sensitive to the presence of outliers; see Indurkhya et al (2001) and Wen et al (2013). Thus it is of interest to see the extent to which our methodology is sensitive to the various mechanisms that could result in outliers in the data.…”

Minimally invasive mitral valve surgery in high-risk patients: operating outside the boxplot

“…Thus, we thought that it would have been statistically appropriate to consider the 'outliers of risk' as the patients at increased risk. Outliers, if not data error, are normally very informative [16] and although they have small distribution, they have polarized the attention of different researchers of different fields, from public health [17,18] to statistics and cost-effectiveness analysis [19].…”