A semi-holographic hyperdimensional representation system for hardware-friendly cognitive computing

Serb, Alexantrou; Kobyzev, Ivan; Wang, J.; Prodromakis, Themis

doi:10.1098/rsta.2019.0162

Cited by 3 publications

(1 citation statement)

References 28 publications

(58 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Other frequent primitives such as binding and bundling can also benefit from low-power hardware realization 40 .…”

Section: Discussionmentioning

confidence: 99%

A Neuro-vector-symbolic Architecture for Solving Raven's Progressive Matrices

Hersche¹,

Zeqiri²,

Benini³

et al. 2022

Preprint

View full text Add to dashboard Cite

Neither deep neural networks nor symbolic AI alone have approached the kind of intelligence expressed in humans. This is mainly because neural networks are not able to decompose distinct objects from their joint representation (the so-called binding problem), while symbolic AI suffers from exhaustive rule searches, among other problems. These two problems are still pronounced in neuro-symbolic AI which aims to combine the best of the two paradigms.Here, we show that the two problems can be addressed with our proposed neuro-vector-symbolic architecture (NVSA) by exploiting its powerful operators on fixed-width holographic vectorized representations that serve as a common language between neural networks and symbolic logical reasoning. The efficacy of NVSA is demonstrated by solving the Raven's progressive matrices. NVSA achieves a new record of 97.7% average accuracy in RAVEN, and 98.8% in I-RAVEN datasets, with two orders of magnitude faster execution than the symbolic logical reasoning on CPUs.Human fluid intelligence is the ability to think and reason abstractly, and make inferences in a novel domain. The Raven's progressive matrices (RPM) 1 test has been a widely-used assessment of fluid intelligence and abstract reasoning 2,3 . The RPM is a non-verbal test which involves perceiving pattern continuation, element abstraction, and finding relations between abstract elements based on underlying rules. Each RPM test is an analogy problem presented as a 3×3 pictorial matrix of context panels. Every panel in the matrix is filled with several geometric objects based on a certain rule, except the last panel which is left blank. The participants are asked to complete the missing panel in the matrix by picking the correct answer from a set of candidate answer panels that matches the implicit rule (see Methods and Supplementary Fig. 1). Solving this test mainly involves two aspects of intelligence: visual perception and abstract reasoning.As opposed to deep learning methods that blend perception and reasoning in a monolithic model [4][5][6] , the reasoning capability is not necessarily interwoven with the visual perception in humans. For instance, one can close one's eyes and build a scene representation through touch, followed by reasoning that remains effortless without the vision 7 . This decoupling is at the core of hybrid systems that advocate combining subsymbolic (e.g., neural networks) with symbolic artificial intelligence, aiming to reach human-level generalization [8][9][10][11] . Among the hybrid systems, neuro-symbolic architectures separately handle the perception and reasoning aspects by using a combination of neural networks and symbolic approaches. Considerable effort has been devoted to integrate these two paradigms that led to the state-of-the-art performance of neuro-symbolic architectures in various tasks, e.g., visual question answering 7,12,13 , causal video reasoning 14 , and solving RPM 15 . However, the resulting neuro-symbolic architectures are not immune to the potential problems of their indiv...

show abstract

“…Other frequent primitives such as binding and bundling can also benefit from low-power hardware realization 40 .…”

Section: Discussionmentioning

confidence: 99%