A programmable processing array architecture supporting dynamic task scheduling and module-level prefetching

Abstract

Massively Parallel Processing Arrays (MPPA) constitute programmable hardware accelerators that excel in the execution of applications exhibiting Data-Level Parallelism (DLP). The concept of employing such programmable accelerators as sidekicks to the more traditional, general-purpose processing cores has very recently entered the mainstream; both Intel and AMD have introduced processor architectures integrating a Graphics Processing Unit (GPU) alongside the main CPU cores. These GPU engines are expected to play a pivotal role in the espousal of General-Purpose computing on GPUs (GPGPU). However, the widespread adoption of MPPAs, in general, as hardware accelerators entails the effective tackling of some fundamental obstacles: the expressiveness of the programming model, the debugging capabilities, and the memory hierarchy design. Toward this end, this paper proposes a hardware architecture for MPPA that adopts an event-driven execution model. It supports dynamic task scheduling, which offers better expressiveness to the execution model and improves the utilization of processing elements. Moreover, a novel module-level prefetching mechanism -enabled by the specification of the execution model -hides the access time to memory and the scheduler. The execution model also ensures complete encapsulation of the modules, which greatly facilitates debugging. Finally, the fact that all associated inputs of a module are explicitly known can be exploited by the hardware to hide memory access latency without having to resort to caches and a cache Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy otherwise, to republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. coherence protocol. Results using a cycle-level simulator of the proposed architecture and a variety of real application benchmarks demonstrate the efficacy and efficiency of the proposed paradigm.

TornadoNoC

“…On the other hand, the power wall [Esmaeilzadeh et al 2011] forces each core to be extremely power efficient. A heterogeneous architecture that employs a small number of powerful cores along with a large number of power-efficient small cores has also appeared as an emerging paradigm [Lee et al 2012]. It is expected that the number of cores on a single die will continue to increase, but the power efficiency of each core must also be enhanced.…”

TornadoNoC

“…On the other hand, the power wall [Esmaeilzadeh et al 2011] forces each core to be extremely power efficient. A heterogeneous architecture that employs a small number of powerful cores along with a large number of power-efficient small cores has also appeared as an emerging paradigm [Lee et al 2012]. It is expected that the number of cores on a single die will continue to increase, but the power efficiency of each core must also be enhanced.…”