A neural network simulator for supercomputers

Maki, William S.; Abunawass, Adel M.

doi:10.3758/bf03205586

Cited by 3 publications

(4 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The original BP (OBP) model [9j and the AMC model (as described above) were used to train all the networks using the Neural Networks Simulator described in [1,6]. The weights were adjusted after each input/output pattern in the list.…”

Section: Simulationsmentioning

confidence: 99%

<title>Negative transfer problem in neural networks</title>

Abunawass

1992

SPIE Proceedings

Self Cite

View full text Add to dashboard Cite

Harlow, 1949, observed that when human subjects were trained to perform simple discrimination tasks over a sequence of successive training sessions (trials), their performance improved as a function of the successive sessions. Harlow called this phenomena "learning-to-learn" . The subjects acquired knowledge and improved their ability to learn in future training sessions. It seems that previous training sessions contribute positively to the current one. , observed that when a neural network (using the back-propagation model) is trained over successive sessions, the performance and learning ability of the network degrade as a function of the training sessions. In some cases this leads to a complete paralysis of the network. Abunawass & Maki called this phenomena the "negative transfer" problem, since previous training sessions contribute negatively to the current one. The effect of the negative transfer problem is in clear contradiction to that reported by Harlow on human subjects. Since the ability to model human cognition and learning is one of the most important goals (and claims) of neural networks, the negative transfer problem represents a clear limitation to this ability. This paper describes a new neural network sequential learning model known as Adaptive Memory Consolidation. In this model the network uses its past learning experience to enhance its future learning ability. Adaptive Memory Consolidation has led to the elimination and reversal of the effect of the negative transfer problem. Thus producing a "positive transfer" effect similar to Harlow's learning-to-learn phenomena. BACKGROUND Artificial Neural NetworksArtificial neural networks (also known as connectionist models, adaptive neural networks, neural networks, adaptive systems, neuromorphic systems and parallel distributed processing) have a rich history, numerous successes and a wide appeal. The appeal of artificial neural networks includes the potential of brain-like computations and human-like learning and intelligence. We believe that for an artificial model to be a viable model of learning and intelligence, the model must be capable of matching the experimental results of its natural counterpart. Loosely stated, the artificial model must be able to mimic and exhibit the behavior of the natural one. Artificial neural networks have problems that limit their ability to mimic the behavior of the natural ones; one such problem is the topic of this paper. In the paper we are limiting our focus to the back-propagation (BP) model [8].Artificial neural networks have a similar topography to directed graphs (see Figure 1). The nodes in the graph are known as units or neurons. The edges of the graph are known as connections or synapses. The units are linked to each other via connections. The connections are unidirectional. Each unit has output and input values. Each connection has a weight value. The weights of the connections represent the long term memory (LTM) of the network. LTM contains the learning the network has accomplished. LTM is the perma...

show abstract

Section: Simulationsmentioning

confidence: 99%

<title>Negative transfer problem in neural networks</title>

Abunawass

1992

SPIE Proceedings

Self Cite

View full text Add to dashboard Cite

show abstract

“…The second component is the Neural Network Simulator (NNS) [8]. The third component is the Neural Network Data Analyzers (NNDA).…”

Section: The Software Toolsmentioning

confidence: 99%

“…Reports produced by NNS come in a variety of formats that are compatible with the NNDA. NNS was developed in a joint effort by Adel M. Abunawass and W. S. Maki [8]. NNS is written in FORTRAN and runs on the IBM 3090-200E and the Cray X-MP/48 supercomputers.…”

Section: The Software Toolsmentioning

confidence: 99%

See 1 more Smart Citation

A first undergraduate course in neural networks

Abunawass¹,

Bukhres²,

Fisher³

et al. 1990

Proceedings of the Twenty-First SIGCSE Technical Symposium on Computer Science Education

Self Cite

View full text Add to dashboard Cite

Tomorrow's marketplace demands that computer science students be familiar with neural networks. This paper describes a course on neural networks. The course is to be offered as a part of the undergraduate curriculum in computer science. This paper contains the basic information on neural network topics as well as the course curriculum. This paper also describes public domain software support tools for use in this course. A brief description of class projects is provided.A justification of the course in the computer science curriculum is presented.

show abstract

The negative transfer problem in neural networks: a solution

Abunawass

1991

[Proceedings] 1991 IEEE International Joint Conference on Neural Networks

View full text Add to dashboard Cite

A neural network simulator for supercomputers

Cited by 3 publications

References 16 publications

<title>Negative transfer problem in neural networks</title>

<title>Negative transfer problem in neural networks</title>

A first undergraduate course in neural networks

The negative transfer problem in neural networks: a solution

Contact Info

Product

Resources

About