Hyperdimensional Hybrid Learning on End-Edge-Cloud Networks

Issa, Mariam; Shahhosseini, Sina; Ni, Yang; Hu, Tianyi; Abraham, Danny; Rahmani, Amir M.; Dutt, Nikil; Imani, Mohsen

doi:10.1109/iccd56317.2022.00100

Cited by 9 publications

(2 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the past few years, prior HDC research works have applied the brain-like functionalities of HDC to diverse applications, for example, outlier detection (Wang et al, 2022 ), biosignal processing (Rahimi et al, 2020 ; Ni et al, 2022c ; Pale et al, 2022 ), speech recognition (Hernandez-Cane et al, 2021 ), and gesture recognition (Rahimi et al, 2016 ). Apart from classification learning tasks, it has also been applied to genomic sequencing (Zou et al, 2022 ; Barkam et al, 2023b ), nonlinear regression (Hernández-Cano et al, 2021 ; Ni et al, 2023b ), reinforcement learning (Chen et al, 2022 ; Issa et al, 2022 ; Ni et al, 2022a , 2023a ), and graph reasoning (Poduval et al, 2022a ; Chen et al, 2023 ). With or without hardware acceleration, these HDC algorithms bring a significant efficiency benefit to each application, facilitating online training, few-shot learning, and edge-friendly operation.…”

Section: Related Workmentioning

confidence: 99%

Hyperdimensional computing with holographic and adaptive encoder

Hernández-Cano,

Ni,

Zou

et al. 2024

Front. Artif. Intell.

Self Cite

View full text Add to dashboard Cite

IntroductionBrain-inspired computing has become an emerging field, where a growing number of works focus on developing algorithms that bring machine learning closer to human brains at the functional level. As one of the promising directions, Hyperdimensional Computing (HDC) is centered around the idea of having holographic and high-dimensional representation as the neural activities in our brains. Such representation is the fundamental enabler for the efficiency and robustness of HDC. However, existing HDC-based algorithms suffer from limitations within the encoder. To some extent, they all rely on manually selected encoders, meaning that the resulting representation is never adapted to the tasks at hand.MethodsIn this paper, we propose FLASH, a novel hyperdimensional learning method that incorporates an adaptive and learnable encoder design, aiming at better overall learning performance while maintaining good properties of HDC representation. Current HDC encoders leverage Random Fourier Features (RFF) for kernel correspondence and enable locality-preserving encoding. We propose to learn the encoder matrix distribution via gradient descent and effectively adapt the kernel for a more suitable HDC encoding.ResultsOur experiments on various regression datasets show that tuning the HDC encoder can significantly boost the accuracy, surpassing the current HDC-based algorithm and providing faster inference than other baselines, including RFF-based kernel ridge regression.DiscussionThe results indicate the importance of an adaptive encoder and customized high-dimensional representation in HDC.

show abstract

Section: Related Workmentioning

confidence: 99%

Hyperdimensional computing with holographic and adaptive encoder

Hernández-Cano,

Ni,

Zou

et al. 2024

Front. Artif. Intell.

Self Cite

View full text Add to dashboard Cite

show abstract

“…In the past few years, HDC has gained significant traction as an emerging computing paradigm, especially for its deployments in machine learning and reasoning tasks. Prior works have proposed HDC-based algorithms and learning frameworks for classification [43], [4], [44], clustering [45], [46], regression [47], [9], and reinforcement learning [14], [48], [49] problems, showing the benefit of fast convergence in learning, high power/energy efficiency, natural data reuse and acceleration on customized devices [12], [11], [50], [51], and robustness on error-prone emerging hardware [52], [53]. Particularly, HDC has been successfully applied to many supervised learning tasks.…”

Section: Brain-inspired Hdcmentioning

confidence: 99%