2017
DOI: 10.1038/srep44037
|View full text |Cite
|
Sign up to set email alerts
|

Multiplex visibility graphs to investigate recurrent neural network dynamics

Abstract: A recurrent neural network (RNN) is a universal approximator of dynamical systems, whose performance often depends on sensitive hyperparameters. Tuning them properly may be difficult and, typically, based on a trial-and-error approach. In this work, we adopt a graph-based framework to interpret and characterize internal dynamics of a class of RNNs called echo state networks (ESNs). We design principled unsupervised methods to derive hyperparameters configurations yielding maximal ESN performance, expressed in … Show more

Help me understand this report
View preprint versions

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1
1
1

Citation Types

0
31
0

Year Published

2017
2017
2023
2023

Publication Types

Select...
7
2

Relationship

2
7

Authors

Journals

citations
Cited by 37 publications
(31 citation statements)
references
References 67 publications
(105 reference statements)
0
31
0
Order By: Relevance
“…Each model is configured with the same hyperparameters in all the experiments. Since reservoirs are sensitive to the hyperparameter setting [47], a fine-tuning with independent cross-validation for each task is usually more important in classic RC models than in RNNs trained with gradient descent, such as LSTM and GRU. Nevertheless, we show that the proposed rmESN achieves competitive results even with fixed the hyperparameters.…”
Section: Methodsmentioning
confidence: 99%
“…Each model is configured with the same hyperparameters in all the experiments. Since reservoirs are sensitive to the hyperparameter setting [47], a fine-tuning with independent cross-validation for each task is usually more important in classic RC models than in RNNs trained with gradient descent, such as LSTM and GRU. Nevertheless, we show that the proposed rmESN achieves competitive results even with fixed the hyperparameters.…”
Section: Methodsmentioning
confidence: 99%
“…Bianchi et al (2017) used multiplex visibility networks method based on the weighted HVG algorithm (Section 3.1.5) where the edge weights are given by: wi,j=1/ji2+YiYj2, incorporating temporal and amplitude information of the data. They studied topological measures of the networks to characterize neuron activations.…”
Section: Mapping Multivariate Time Series Into Complex Networkmentioning
confidence: 99%
“…if node i corresponds to a future time than node j, and are visible to each other, then there is connection from i®j but not i¬j 35 . There is also a technique to map multivariate time series into multiplex graphs 36 that may enable analysis of multi-modality monitoring data from the injury site e.g. ISP, tissue oxygen and microdialysis.…”
Section: Discussionmentioning
confidence: 99%