Deep Tower Networks for Efficient Temperature Forecasting from Multiple Data Sources

Abstract

Many data related problems involve handling multiple data streams of different types at the same time. These problems are both complex and challenging, and researchers often end up using only one modality or combining them via a late fusion based approach. To tackle this challenge, we develop and investigate the usefulness of a novel deep learning method called tower networks. This method is able to learn from multiple input data sources at once. We apply the tower network to the problem of short-term temperature forecasting. First, we compare our method to a number of meteorological baselines and simple statistical approaches. Further, we compare the tower network with two core network architectures that are often used, namely the convolutional neural network (CNN) and convolutional long short-term memory (convLSTM). The methods are compared for the task of weather forecasting performance, and the deep learning methods are also compared in terms of memory usage and training time. The tower network performs well in comparison both with the meteorological baselines, and with the other core architectures. Compared with the state-of-the-art operational Norwegian weather forecasting service, yr.no, the tower network has an overall 11% smaller root mean squared forecasting error. For the core architectures, the tower network documents competitive performance and proofs to be more robust compared to CNN and convLSTM models.

An Integrated Framework for Spatiotemporally Merging Multi-Sources Precipitation Based on F-SVD and ConvLSTM

“…From the spatial distribution of the rainfall data before and after fusion presented in Figures 8 and 9, it is evident that the fusion process retains the distribution features of both data sources while achieving higher accuracy. The introduction of multiple input channels in the ConvLSTM model enables the simultaneous processing of inputs from multiple data sources [31]. This allows the model to leverage the strengths of each data source, capture their spatial features, and retain the expression of these features in the fusion results.…”

Deep learning methods to forecasting human embryo development in time-lapse videos

“…The embryo was in the 2-cell stage in the first and 3-cell stage in the second frame. We used ConvLSTM to build the video frame prediction model because ConvLSTM has been widely applied for predicting the upcoming frames using previous frames [27][28][29][30].…”