Time series forecasting by recurrent product unit neural networks

Abstract

Time series forecasting (TSF) consists on estimating models to predict future values based on previously observed values of time series, and it can be applied to solve many real-world problems. TSF has been traditionally tackled by considering autoregressive neural networks (ARNNs) or recurrent neural networks (RNNs), where hidden nodes are usually configured using additive activation functions, such as sigmoidal functions. ARNNs are based on a short-term memory of the time series in the form of lagged time series values used as inputs, while RNNs include a long-term memory structure. The objective of this paper is twofold. First, it explores the potential of multiplicative nodes for ARNNs, by considering product unit (PU) activation functions, motivated by the fact that PUs are specially useful for modelling highly correlated features, such as the lagged time series values used as inputs for ARNNs. Second, it proposes a new hybrid RNN model based on PUs, by estimating the PU outputs from the combination of a long-term reservoir and the short-term lagged time series values. A complete set of experiments with 29 data sets shows competitive performance for both model proposals, and a set of statistical tests confirms that they achieve the state of the art in TSF, with specially promising results for the proposed hybrid RNN. The experiments in this paper show that the recurrent model is very competitive for relatively large time series, where longer forecast horizons are required, while the autoregressive model is a good selection if the data set is small or if a low computational cost is needed.

A Novel Torque Distribution Strategy Based on Deep Recurrent Neural Network for Parallel Hybrid Electric Vehicle

“…The gradient disappearance or gradient explosion will be appeared in the RNN during the long-time information processing, inspired by some studies [37], the paper adopts GRU (gate recurrent unit) and LSTM (Long Short-term memory) unit which are special recurrent neural network, since they could handle the long time dependency. The internal structure of the GRU is shown in the Fig.2; the GRU unit includes Reset gate and Update gate for dealing with information flow.…”

Comparison of neural networks and regression time series in predicting export from Czech Republic into People´s Republic of China

“…in physics, medicine, economics, but also in meteorology. In various fields of human activities, there are efforts to define the development of the given indicator in the past, to identify the factors behind the variety and make predictions for the future [11]. If a company wants to prosper and be competitive in market environment, it should perform a regular financial analysis of its activities, assess its achievements and failures and use the results for predicting the future development of the company [12].…”

Using Artificial Neural Networks for Equalizing Time Series Considering Seasonal Fluctuations

“…physics, technology, medicine, social sciences, and economics as well. Using time series is one of the most significant quantitative methods used in data analysis in economics [3].…”

“…As mentioned above, time series is used in various disciplines, such as economics, medicine, physics or even meteorology [1]. There is an effort to define the development of monitored indicators in the past, find out the causes of variability and subsequently forecast the future in such disciplines [3].…”