Shared Memory and GPU Parallelization of an Operational Atmospheric Transport and Dispersion Application

Yang, Fan; Strazdins, Peter; Henrichs, Joerg; Pugh, Tim

doi:10.1109/ipdpsw.2019.00121

Cited by 1 publication

(1 citation statement)

References 5 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Many applications in engineering and scientific computing involve operations on dense and sparse matrices [1], [2], [3], [4], [5], [6], [7], [8], [9], [10], [11]. At the core of many of these applications is the General Matrix-Matrix multiplication (GEMM) operation, which is regarded as one of the most widely used high performance kernels.…”

Section: Introductionmentioning

confidence: 99%

Extending Shared-Memory Computations to Multiple Distributed Nodes

Ahmed¹

2020

IJACSA

View full text Add to dashboard Cite

With the emergence of accelerators like GPUs, MICs and FPGAs, the availability of domain specific libraries (like MKL) and the ease of parallelization associated with CUDA and OpenMP based shared-memory programming, node-based parallelization has recently become a popular choice among developers in the field of scientific computing. This is evident from the large volume of recently published work in various domains of scientific computing, where shared-memory programming and accelerators have been used to accelerate applications. Although these approaches are suitable for small problem-sizes, there are issues that need to be addressed for them to be applicable to larger input domains. Firstly, the primary focus of these works has been to accelerate the core kernel; acceleration of input/output operations is seldom considered. Many operations in scientific computing operate on large matrices-both sparse and dense-that are read from and written to external files. These input-output operations present themselves as bottlenecks and significantly effect the overall application time. Secondly, node-based parallelization limits a developer from distributing the computation beyond a single node without him having to learn an additional programming paradigm like MPI. Thirdly, the problem size that can be effectively handled by a node is limited by the memory of the node and accelerator. In this paper, an Asynchronous Multi-node Execution (AMNE) approach is presented that uses a unique combination of the shared-file system and pseudo-replication to extend node-based algorithms to a distributed multiple node implementation with minimal changes to the original node-based code. We demonstrate this approach by applying it to GEMM, a popular kernel in dense linear algebra and show that the presented methodology significantly advances the state of art in the field of parallelization and scientific computing.

show abstract

Section: Introductionmentioning

confidence: 99%

Extending Shared-Memory Computations to Multiple Distributed Nodes

Ahmed¹

2020

IJACSA

View full text Add to dashboard Cite

show abstract

Shared Memory and GPU Parallelization of an Operational Atmospheric Transport and Dispersion Application

Cited by 1 publication

References 5 publications

Extending Shared-Memory Computations to Multiple Distributed Nodes

Extending Shared-Memory Computations to Multiple Distributed Nodes

Contact Info

Product

Resources

About