Entropic Associative Memory for Manuscript Symbols

Morales, Rafael; Hernández, Noé; Cruz, Ricardo; Cruz, Victor D.; Pineda, Luis A.

doi:10.21203/rs.3.rs-846238/v1

Cited by 1 publication

(2 citation statements)

References 27 publications

(53 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The Entropic Associative Memory (EAM) 1,2 is a novel declarative but distributed model of associative memory. EAM consists on a set of Associative Memory Registers (AMRs) implemented as finite bi-dimensional arrays or tables.…”

Section: Entropic Associative Memorymentioning

confidence: 99%

“…In the basic scenario, each AMR holds the representation of a set of objects of the same class. In previous work we used ten AMRs for holding the representations of the ten digits 1 ; and 47 AMRs for holding the representations of capital and lower case letters and digits 2 . We also showed that AMRs can hold representations of more than one class of objects simultaneously, with satisfactory precision and recall, but a moderate increase of the entropy.…”

Section: Entropic Associative Memorymentioning

confidence: 99%

See 1 more Smart Citation

Weighted Entropic Associative Memory: A case study on Phonetic Representation and Learning

Pineda

Morales

2022

Preprint

Self Cite

View full text Add to dashboard Cite

The Entropic Associative Memory (EAM) holds declarative but distributed representations of remembered objects. These are characterized as functions from features to discrete values in an abstract amodal space. Memory objects are registered or remembered through a declarative operation; memory recognition is defined as a logical test and cues of objects not contained in the memory are rejected directly without search; and memory retrieval is a constructive operation. In its original formulation, the content of basic memory units or cells was either on or off, hence all stored objects had the same weight or strength. In the present weighted version (W-EAM) we introduce a basic learning mechanism to the effect that the values of the cells used in the representation of an object are reinforced by the memory register operation. As memory cells are shared by different representations, the corresponding associations are reinforced too. The memory system supports a second form of learning: the distributed representation generalizes and renders a large set of potential or latent units that can used for recognizing novel inputs, which can in turn be used for improving the performance of both the deep neural networks used for modelling perception and action, and of the memory operations. This process can be performed recurrently in open-ended fashion and can be used in long term learning. An experiment in the phonetic domain using the Mexican Spanish DIMEx100 Corpus was carried out. This corpus was collected in a controlled noise-free environment, and was transcribed manually by human trained phoneticians, but consists of a relatively small number of utterances. DIMEx100 was used to produced the initial state of the perceptual and motor modules, and for testing the performance of the memory system at such state. Then the incremental learning cycle was modelled using the Spanish CIEMPIESS Corpus, consisting of a very large number of noisy untagged speech utterances collected from radio and TV. The results support the viability of the Weighted Entropic Associative Memory for modelling cognitive processes, such as phonetic representation and learning, for the construction of applications, such as speech recognition and synthesis, and as a computational model of natural memory.

show abstract

Section: Entropic Associative Memorymentioning

confidence: 99%

Section: Entropic Associative Memorymentioning

confidence: 99%