Memory Pooling With CXL

Gouk, Donghyun; Kwon, Miryeong; Bae, Hanyeoreum; Lee, Sang‐Won

doi:10.1109/mm.2023.3237491

Cited by 26 publications

(3 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…DirectCXL [77] is the first (and only) proposal we cover that utilizes the newly introduced CXL protocol. DirectCXL realizes normal CPU servers of today as memory hosts, with passive remote memory blades comprising only of DRAM memories along with a CXL enabled memory controller.…”

Section: ) Hardware Based Systemsmentioning

confidence: 99%

Disaggregated Memory in the Datacenter: A Survey

Ewais

Chow

2023

IEEE Access

View full text Add to dashboard Cite

Datacenters of today have maintained the same architecture for decades. The building block of the datacenter remains the server, which tightly couples the necessary compute resources, memory, and storage to run its tasks. However, this traditional approach suffers from under-utilization of its resources, often caused by the over-provisioning of these resources when deploying applications. Datacenter operators allocate the worst-case amount of memory required for each deployed application, which lasts for the entirety of the application's lifetime, even when not actually used. This causes servers to quickly, and falsely, run out of memory before their CPUs have been fully utilized. To address these problems, a new shift in the way datacenters are being built has been gaining more traction. Namely, memory disaggregation. Memory disaggregation can address these problems by decoupling the computational elements from the memory resources, allowing each to be provisioned and utilized separately. While the idea of memory disaggregation is not new, an increasing number of different proposals of memory disaggregation have seen the light in recent years. In this paper, we review many of these recent proposals, and study their architectures, implementations, and requirements. We also categorize them based on their features, and attempt to identify their strengths and shortcomings in an effort to highlight possible directions for future work and provide a reference for the research community.

show abstract

Section: ) Hardware Based Systemsmentioning

confidence: 99%

Disaggregated Memory in the Datacenter: A Survey

Ewais

Chow

2023

IEEE Access

View full text Add to dashboard Cite

show abstract

“…CXL analysis and evaluation: CXL is an emerging standard that is attracting attention not only from industry but also from research communities. Analysis and evaluation of CXL-enabled systems are being conducted ranging from memory pooling in general [12,23,41,44,46], to more specific applications such as machine learning [19] and in-memory databases [21]. CXL studies involving accelerators such as GPU and FPGA are appearing [3,19].…”

Section: Related Workmentioning

confidence: 99%

GPU Graph Processing on CXL-Based Microsecond-Latency External Memory

Sano,

Bando,

Hiwada

et al. 2023

Proceedings of the SC '23 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analys

View full text Add to dashboard Cite

In GPU graph analytics, the use of external memory such as the host DRAM and solid-state drives is a cost-effective approach to processing large graphs beyond the capacity of the GPU onboard memory. This paper studies the use of Compute Express Link (CXL) memory as alternative external memory for GPU graph processing in order to see if this emerging memory expansion technology enables graph processing that is as fast as using the host DRAM. Through analysis and evaluation using FPGA prototypes, we show that representative GPU graph traversal algorithms involving finegrained random access can tolerate an external memory latency of up to a few microseconds introduced by the CXL interface as well as by the underlying memory devices. This insight indicates that microsecond-latency flash memory may be used as CXL memory devices to realize even more cost-effective GPU graph processing while still achieving performance close to using the host DRAM. CCS CONCEPTS• Hardware → Analysis and design of emerging devices and systems; Memory and dense storage.

show abstract

“…Second, it is designed to reach low latencies even for remote memory extensions (around 600ns), making it a new intermediate between accesses to local memory and RDMA. Some early work on CXL compared it with RDMA accesses and reached significant improvements [42] on the latency. Third, even if it can support RAM extension cards, CXL is also meant to be compatible with a large range of extension devices, from memory-equipped accelerators, i.e., Graphics Processing Unit (GPU)s or Field-Programmable Gate Array (FPGA)s, to persistent memory.…”

Section: CXLmentioning

confidence: 99%

Towards new memory paradigms : integrating non-volatile main memory and remote direct memory access in modern systems

Dulong

View full text Add to dashboard Cite

Modern computers are built around two main parts: their Central Processing Unit (CPU), and their volatile main memory, or Random Access Memory (RAM). The basis of this architecture takes its roots in the 1970's first computers. Since, this principle has been constantly upgraded to provide more functionnality and performance.In this thesis, we study two memory paradigms that drastically change the way we can interact with memory in modern systems: non-volatile memory and remote memory access. We implement software tools that leverage them in order to make them compatible and exploit their performance with concrete applications. We also analyze the impact of the technologies underlying these new memory medium, and the perspectives of their evolution in the coming years.For non-volatile memory, as the main memory performance is key to unlock the full potential of a CPU, this feature has historically been abandoned on the race for performance. Even if the first computers were designed with non-volatile forms of memory, computer architects started to use volatile RAM for its incomparable performance compared to durable storage, and never questioned this decision for years. However, in 2019 Intel released a new component called Optane DC Persistent Memory (DCPMM), a device that made possible the use of Non-Volatile Main Memory (NVMM). That product, by its capabilities, provides a new way of thinking about data persistence. Yet, it also challenges the hardware architecture used in our current machines and the way we program them.With this new form of memory we implemented NVCACHE, a cache designed for non-volatile memory that helps boosting the interactions with slower persistent storage medias, such as Solid State Drive (SSD). We find NVCACHE to be quite performant for workloads that require a high granularity of persistence guarantees, while being as easy to use as the traditional POSIX interface. Compared to file systems designed for NVMM, NVCACHE can reach similar or higher throughput when the non-volatile memory is used. In addition, NVCACHE allows the code to exploit NVMM performance while not being limited by the amount of NVMM installed in the machine.Another major change of in the computer landscape has been the popularity of distributed systems. As individual machines tend to reach performance limitations, iii

show abstract

Memory Pooling With CXL

Cited by 26 publications

References 10 publications

Disaggregated Memory in the Datacenter: A Survey

Disaggregated Memory in the Datacenter: A Survey

GPU Graph Processing on CXL-Based Microsecond-Latency External Memory

Towards new memory paradigms : integrating non-volatile main memory and remote direct memory access in modern systems

Contact Info

Product

Resources

About