Forecasting Daily Emergency Department Arrivals Using High-Dimensional Multivariate Data: A Feature Selection Approach

Abstract

Background and Objective Emergency Department (ED) overcrowding is a chronic international issue that is associated with adverse treatment outcomes. Accurate forecasts of future service demand would enable intelligent resource allocation that could alleviate the problem. There has been continued academic interest in ED forecasting but the number of used explanatory variables has been low, limited mainly to calendar and weather variables. In this study we investigate whether predictive accuracy of next day arrivals could be enhanced using high number of potentially relevant explanatory variables and document two feature selection processes that aim to identify which subset of variables is associated with number of next day arrivals.Methods We extracted numbers of total daily arrivals from Tampere University Hospital ED between the time period of June 1, 2015 and June 19, 2019. 158 potential explanatory variables were collected from multiple data sources consisting not only of weather and calendar variables but also an extensive list of local public events, numbers of website visits to two hospital domains, numbers of available hospital beds in 33 local hospitals or health centres and Google trends searches for the ED. We used two feature selection processes: Simulated Annealing (SA) and Floating Search (FS) with Recursive Least Squares (RLS) and Least Mean Squares (LMS). Performance of these approaches was compared against autoregressive integrated moving average (ARIMA), regression with ARIMA errors (ARIMAX) and Random Forest (RF). Mean Absolute Percentage Error (MAPE) was used as the main error metric.Results Calendar variables, load of secondary care facilities and local public events were dominant in the identified predictive features. RLS-SA and RLS-FA provided slightly better accuracy compared ARIMA. ARIMAX was the most accurate model but the difference between RLS-SA and RLS-FA was not statistically significant.Conclusions Our study provides new insight into potential underlying factors associated with number of next day presentations. It also suggests that predictive accuracy of next day arrivals can be increased using high-dimensional feature selection approach when compared to both univariate and nonfiltered high-dimensional approach. However, outperforming ARIMAX remains a challenge when working with daily data. Future work should focus on enhancing the feature selection mechanism, investigating its applicability to other domains and in identifying other potentially relevant explanatory variables.

A Multi-Granular Stacked Regression for Forecasting Long-Term Demand in Emergency Departments

“…Exponential Smoothing [7,8,11] and, more recently, Machine Learning (ML) algorithms [5,8,10,12,13,16]. Cohort studies have found that measures of social deprivation and comorbidities are predictive of ED attendances [17][18][19] and low General Practice (GP) attendance is associated with low ED attendance [18].…”

“…Previous studies have mostly focussed on predicting short-term ED attendances [4-12] using past attendances [4,5,7,8, 10-14], calendar [5,7,9,10,14] and meteorological variables [5,9,14]. The most common techniques employed are Multiple Linear Regression [7,9,11,15], Autoregressive Integrated Moving Average (ARMIA) and variants [4,5,7,8,12,13], Exponential Smoothing [7,8,11] and, more recently, Machine Learning (ML) algorithms [5,8,10,12,13,16]. Cohort studies have found that measures of social deprivation and co-morbidities are predictive of ED attendances [17-19] and low General Practice (GP) attendance is associated with low ED attendance [18].…”

A multi-granular stacked regression for forecasting long-term demand in Emergency Departments

“…Previous studies have mostly focussed on predicting short-term ED attendances [4][5][6][7][8][9][10][11][12] using past attendances [4,5,7,8,[10][11][12][13][14], calendar [5,7,9,10,14] and meteorological variables [5,9,14]. The most common techniques employed are Multiple Linear Regression [7,9,11,15], Autoregressive Integrated Moving Average (ARMIA) and variants [4,5,7,8,12,13], Exponential Smoothing [7,8,11] and, more recently, Machine Learning (ML) algorithms [5,8,10,12,13,16]. Cohort studies have found that measures of social deprivation and co-morbidities are predictive of ED attendances [15,17,...…”