About Influence of Weight Initialization Algorithms on Accuracy of the Forecast with LSTM-net for Harmonic Signals

Timoshenkova, Yulia; Safiullin, Nikolai; Поршнев, С. В.

doi:10.1109/usbereit51232.2021.9455014

Cited by 2 publications

(1 citation statement)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…However, such values can be incorporated, but the model may require a different structure to prevent difficulties like those described by Blumenfeld et al [31]. Multiple different approaches to establishing the initial weight function have been developed, along with much research on their impact on the model, such as [32] and [33].…”

Section: Feedforward Neural Networkmentioning

confidence: 99%

Efficient Algorithms for Artificial Neural Networks and Explainable AI

Eshkiki¹

View full text Add to dashboard Cite

Artificial neural networks have allowed some remarkable progress in fields such as pattern recognition and computer vision. However, the increasing complexity of artificial neural networks presents a challenge for efficient computation. In this thesis, we first introduce a novel matrix multiplication method to reduce the complexity of artificial neural networks, where we demonstrate its suitability to compress fully connected layers of artificial neural networks. Our method outperforms other state-of-the-art methods when tested on standard publicly available datasets. This thesis then focuses on Explainable AI, which can be critical in fields like finance and medicine, as it can provide explanations for some decisions taken by sub-symbolic AI models behaving like a black box such as Artificial neural networks and transformationbased learning approaches. We have also developed a new framework that facilitates the use of Explainable AI with tabular datasets. Our new framework Exmed, enables nonexpert users to prepare data, train models, and apply Explainable AI techniques effectively.Additionally, we propose a new algorithm that identifies the overall influence of input features and minimises the perturbations that alter the decision taken by a given model.Overall, this thesis introduces innovative and comprehensive techniques to enhance the efficiency of fully connected layers in artificial neural networks and provide a new approach to explain their decisions. These methods have significant practical applications in various fields, including portable medical devices. i Another person I would like to thank is Professor Xiangua Xie for all his assistance and support during this Ph.D.

show abstract

Section: Feedforward Neural Networkmentioning

confidence: 99%