PGASUS: A Framework for C++ Application Development on NUMA Architectures

Hagen, Wieland; Plauth, Max; Eberhardt, Felix; Feinbube, Frank; Polze, Andreas

doi:10.1109/candar.2016.0071

Cited by 6 publications

(2 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To make it easier for developers to co‐locate data and threads, PGASUS provides simple NUMA‐aware parallel tasking facilities that follow the general concepts of the interfaces for threading and asynchronous calls in C++11 and onwards. In a preceding workshop paper, a preliminary description of the PGASUS has already been published, 8 lacking many details and an appreciable evaluation. In the detailed evaluation presented in the article at hands, we demonstrate that PGASUS provides average performance improvements of

1.56 \times

and peak performance improvements of up to

4.67 \times

across a comprehensive benchmark suite comprised of a text histogram application, a data compression workload, and a database ‐oriented use case.…”

Section: Introductionmentioning

confidence: 99%

“…To make it easier for developers to co-locate data and threads, PGASUS provides simple NUMA-aware parallel tasking facilities that follow the general concepts of the interfaces for threading and asynchronous calls in C++11 and onwards. In a preceding workshop paper, a preliminary description of the PGASUS has already been published, 8 lacking many details and an appreciable evaluation.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Improving the accessibility of NUMA‐aware C++ application development based on the PGASUS framework

Plauth

Eberhardt

Grapentin

et al. 2022

Concurrency and Computation

Self Cite

View full text Add to dashboard Cite

Certain workloads such as in-memory databases are inherently hard to scale-out and rely on cache-coherent scale-up non-uniform memory access (NUMA) systems to keep up with the ever-increasing demand for compute resources. However, many parallel programming frameworks such as OpenMP do not make efficient use of large scale-up NUMA systems as they do not consider data locality sufficiently. In this work, we present PGASUS, a C++ framework for NUMA-aware application development that provides integrated facilities for NUMA-aware task parallelism and data placement.The framework is based on an extensive review of parallel programming languages and frameworks to incorporate the best practices of the field. In a comprehensive evaluation, we demonstrate that PGASUS provides average performance improvements of 1.56× and peak performance improvements of up to 4.67×across a wide range of workloads. K E Y W O R D Snon-uniform memory access, programming model, scale-up computing INTRODUCTIONThe ever-increasing demand for compute resources necessitates continuous improvements in computer technology. Even though accelerators such as graphics processing units (GPUs) and field-programmable gate arrays (FPGAs) are commonly used in many data-intensive applications, the majority of workloads still rely on the flexibility and versatility of multicore central processing units (CPUs). 1 Many of those CPU-based workloads can be adapted to scale-out across multiple systems to provide sufficient compute resources. Still, certain workloads such as in-memory databases 2 or de Novo genome assembly 3 are inherently hard to scale out and therefore require as many resources as possible in a single scale-up system.The most basic multi-CPU systems have employed uniform memory access (UMA) architectures, where multiple multicore CPUs are attached to a shared memory subsystem through facilities such as a front-side bus (FSB). All ×86-based systems until the introduction of the SledgeHammer and Nehalem micro architecture in 2009 were built with this memory architecture. From a software developers' perspective, UMA systems align conveniently with the shared memory programming model. Unfortunately, sharing the memory subsystem with all other multicore CPUs severely limits the scalability of multiprocessor systems, both in the number of multicore CPUs as well as in the amount of memory that can be accommodated in a single system.Non-uniform memory access (NUMA) systems avoid this bottleneck, as each multicore CPU is equipped with dedicated memory controllers.Memory attached to other multicore CPUs can still be accessed transparently through inter-CPU interconnects such as Ultra Path Interconnect (UPI), Infinity Fabric (IF), and Power with A-bus, X-bus, OpenCAPI, and NVLink (PowerAXON). However, remote memory access operations incur increased latencies and reduced bandwidth, especially on systems with more than four multicore CPUs where fully meshed connectivity among CPUs is no longer feasible. State-of-the-art NUMA systems support up to 32 multicore C...

show abstract