Enabling composite applications through an asynchronous shared memory interface

Otstott, Douglas; Evans, Noah; Ionkov, Latchesar; Zhao, Ming; Lang, Michael

doi:10.1109/bigdata.2014.7004236

Cited by 7 publications

(5 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…There are several projects that look at combining Linux functionality with an LWK. Kitten/Palacios, Fused OS, McKernel, and mOS are driven by anticipated usage models of future machines [20,4]. The projects differ in how they provide Linux functionality while achieving LWK performance and scalability.…”

Section: Next-generation Lwkmentioning

confidence: 99%

What is a Lightweight Kernel?

Riesen¹,

Maccabe²,

Gerofi³

et al. 2015

Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers

View full text Add to dashboard Cite

Lightweight kernels (LWK) have been in use on the compute nodes of supercomputers for decades. Although many high-end systems now run Linux, interest in options and alternatives has increased in the last couple of years. Future extreme-scale systems require rethinking of the operating system, and modern LWKs may well play a role in the final solution.In the course of our research, it has become clear that no single definition for a lightweight kernel exists. This paper describes what we mean by the term and what makes LWKs different from other operating system kernels.

show abstract

Section: Next-generation Lwkmentioning

confidence: 99%

What is a Lightweight Kernel?

Riesen¹,

Maccabe²,

Gerofi³

et al. 2015

Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers

View full text Add to dashboard Cite

show abstract

“…This application, coupled using TCASM, was originally described elsewhere [27]. At the end of each time step, the SNAP simulation publishes its data via TCASM's copy-on-write approach.…”

Section: Neutronics Energy Spectrum Analysismentioning

confidence: 99%

“…As such, the United States Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only. and debugging systems [35,37,27,25,30,32,7]. This emergence is a result of the changing compute/memory/IO balance of high-end computer systems, the push toward increasing physical fidelity and realism in simulations motivating increasing use of coupled multiphysics simulations, and the generally increasing size and richness of data generated.…”

Section: Introductionmentioning

confidence: 97%

System-Level Support for Composition of Applications

Kocoloski

Lange

Abbasi

et al. 2015

Proceedings of the 5th International Workshop on Runtime and Operating Systems for Supercomputers

Self Cite

View full text Add to dashboard Cite

Current HPC system software lacks support for emerging application deployment scenarios that combine one or more simulations with in situ analytics, sometimes called multi-component or multi-enclave applications. This paper presents an initial design study, implementation, and evaluation of mechanisms supporting composite multi-enclave applications in the Hobbes exascale operating system. These mechanisms include virtualization techniques isolating application custom enclaves while using the vendor-supplied host operating system and high-performance inter-VM communication mechanisms. Our initial single-node performance evaluation of these mechanisms on multi-enclave science applications, both real and proxy, demonstrate the ability to support multi-enclave HPC job composition with minimal performance overhead.

show abstract

“…Historically, processes running on the same node used shared memory techniques, complemented by double-and multibuffer algorithms to improve performance. New techniques, such as TCASM [27] further improve the local sharing by eliminating most of the need of synchronization between applications. Across nodes, applications use three main techniques for sharing data: files on parallel filesystem, explicit message passing, and partitioned global address space (PGAS) approaches like SHMEM and GASNet.…”

Section: Evolving Sharing Considerationsmentioning

confidence: 99%

“…TCASM [27] is a shared-memory copy-on-write kernel that allows asynchronous progress between the publisher of data and one or more observer(s). TCASM consists of kernel-level modifications to multiple memory management functions, the most significant being the msync system call.…”

Section: Implementation 51 Existing Softwarementioning

confidence: 99%

Unity

Jones

Brim

Vallée

et al. 2017

Proceedings of the 7th International Workshop on Runtime and Operating Systems for Supercomputers ROSS 2017

Self Cite

View full text Add to dashboard Cite

This paper describes the vision for UNITY , a new high-performance computing focused data storage abstraction that places the entire memory hierarchy, including both traditionally separated memoryand file-based data storage, into one storage continuum. Through the use of a novel API and a set of services centered around a smart runtime system, UNITY is able to provide a number of valuable and interesting benefits. The unified storage space provides a scalable and resilient data environment that dynamically manages the mapping of data onto available resources based on multiple factors, including desired persistence and energy budget considerations. By eliminating the need for high-performance computing domain scientists to develop architecture-dependent optimizations for rapidly evolving data storage technologies, UNITY addresses both ease-of-use and performance.

show abstract

Enabling composite applications through an asynchronous shared memory interface

Cited by 7 publications

References 10 publications

What is a Lightweight Kernel?

What is a Lightweight Kernel?

System-Level Support for Composition of Applications

Unity

Contact Info

Product

Resources

About