2019 IEEE 62nd International Midwest Symposium on Circuits and Systems (MWSCAS) 2019
DOI: 10.1109/mwscas.2019.8885035
|View full text |Cite
|
Sign up to set email alerts
|

Performance of Three Slim Variants of The Long Short-Term Memory (LSTM) Layer

Abstract: The Long Short-Term Memory (LSTM) layer is an important advancement in the field of neural networks and machine learning, allowing for effective training and impressive inference performance. LSTM-based neural networks have been successfully employed in various applications such as speech processing and language translation. The LSTM layer can be simplified by removing certain components, potentially speeding up training and runtime with limited change in performance. In particular, the recently introduced var… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
2
1

Citation Types

0
13
0

Year Published

2019
2019
2021
2021

Publication Types

Select...
7
2
1

Relationship

0
10

Authors

Journals

citations
Cited by 24 publications
(15 citation statements)
references
References 11 publications
0
13
0
Order By: Relevance
“…Errors are stored and used by LSTMs in back propagation process. Decisions can be made by LSTM, such as what to keep and when to authorize reads [10,35].…”
Section: B Deep Learning Modelsmentioning
confidence: 99%
“…Errors are stored and used by LSTMs in back propagation process. Decisions can be made by LSTM, such as what to keep and when to authorize reads [10,35].…”
Section: B Deep Learning Modelsmentioning
confidence: 99%
“…Errors are stored and used by LSTMs in the back-propagation process. Decisions can be made by LSTM, such as what to keep and when to authorize reads [21,22]. An LSTM network calculates network activations from the data array from the input layer to be transmitted to the data array of the output layer as follows:…”
Section: Deep Learning Modelsmentioning
confidence: 99%
“…LSTMs are put forward as a solution of vanishing or exploding issues of RNNs. Besides, LSTMs are also known as customized version of RNNs [19][20][21]. Essentially, LSTMs are improved in order to attain long-term dependencies that is the missing side of RNNs.…”
Section: Long Short-term Memory Network (Lstms)mentioning
confidence: 99%