Optimizing the Datapath for Key-value Middleware with NVMe SSDs over RDMA Interconnects

An, Zhongqi; Zhang, Zhengyu; Li, Qiang; Xing, Jing; Du, Hao; Wang, Zhan; Huo, Zhigang; Ma, Jie

doi:10.1109/cluster.2017.69

Cited by 5 publications

(1 citation statement)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Many prior studies [8,12,56,71,75,77] use SPDK to directly access the underlying SSD by bypassing all kernel modules in the storage stack. Even though the kernel-bypass is a very promising and attractive approach, it is limited to apply the kernel-bypass to a system that does not have a file system or ACID support.…”

Section: How Much Can Spdk Reduce the System-level Latency Under Amentioning

confidence: 99%

Faster than Flash: An In-Depth Study of System Challenges for Emerging Ultra-Low Latency SSDs

Koh

Jang

Lee

et al. 2019

2019 IEEE International Symposium on Workload Characterization (IISWC)

View full text Add to dashboard Cite

Emerging storage systems with new flash exhibit ultra-low latency (ULL) that can address performance disparities between DRAM and conventional solid state drives (SSDs) in the memory hierarchy. Considering the advanced low-latency characteristics, different types of I/O completion methods (polling/hybrid) and storage stack architecture (SPDK) are proposed. While these new techniques are expected to take costly software interventions off the critical path in ULL-applied systems, unfortunately no study exists to quantitatively analyze system-level characteristics and challenges of combining such newly-introduced techniques with real ULL SSDs.In this work, we comprehensively perform empirical evaluations with 800GB ULL SSD prototypes and characterize ULL behaviors by considering a wide range of I/O path parameters, such as different queues and access patterns. We then analyze the efficiencies and challenges of the polled-mode and hybrid polling I/O completion methods (added into Linux kernels 4.4 and 4.10, respectively) and compare them with the efficiencies of a conventional interrupt-based I/O path. In addition, we revisit the common expectations of SPDK by examining all the system resources and parameters. Finally, we demonstrate the challenges of ULL SSDs in a real SPDK-enabled server-client system. Based on the performance behaviors that this study uncovers, we also discuss several system implications, which are required to take a full advantage of ULL SSD in the future.

show abstract

Section: How Much Can Spdk Reduce the System-level Latency Under Amentioning

confidence: 99%