A study of iSCSI extensions for RDMA (iSER)

Chadalapaka, Mallikarjun; Shah, Hemal; Elzur, Uri; Thaler, Patricia; Ko, Michael

doi:10.1145/944747.944754

Cited by 23 publications

(3 citation statements)

References 3 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This competition will become more intense in the near future with the advent of the high performance interconnection and transport technique, such as Remote Direct Memory Access(RDMA) [20]. We will target the new condition to rethink the storage management again.…”

Section: Discussionmentioning

confidence: 99%

EDOS: Employing Mini-DB for High Semantic Object Store

Feng

Tan

2010

2010 IEEE Fifth International Conference on Networking, Architecture, and Storage

View full text Add to dashboard Cite

Storage management server, compatible with decoupled data and meta data fashion, is being employed frantically to build large-scale distributed storage system for performance and capacity. To design this hot commodity on flexibly managing the extracted data with little meta data but extended attributes has become a big challenge. This paper breaks a new way to object orient store and implement the dedicated prototype, called EDOS. We reexamine several new requirements and prior works, and employ Mini-DB as the back-end (like DBFS) to guarantee the scalability and durability for EDOS. We design three kinds of object locators and multi-indices to improve retrieval performance and absorb random I/O, utilize a swap mechanism between internal and external objects for tunable throughput, which nested beneath the generic key-value database schema and benefited from memory pool technique. The replication component in Mini-DB helps to build the multi nodes in the distributed environment. It is easy to build up the object-based distributed file system by EDOS with ACID transaction semantics and high reliability. The experimental results show that our kernel-level implementation of EDOS performed better than the other existences in practice.

show abstract

Section: Discussionmentioning

confidence: 99%

EDOS: Employing Mini-DB for High Semantic Object Store

Feng

Tan

2010

2010 IEEE Fifth International Conference on Networking, Architecture, and Storage

View full text Add to dashboard Cite

show abstract

“…As such, they are used by kernel-based I/O subsystems (e.g., network file systems [5] and storage device drivers [6]), whereas user-level RNICs can be used by either user-level or kernel-based I/O subsystems [13]. In previous work we argued that the performance drawback of using a kernel-based RNIC instead of a userlevel RNIC amounts to the overhead of crossing the userkernel boundary for issuing and managing I/O operations, which is not a significant cost for I/O-intensive network storage workloads [14].…”

Section: Kernel-based Rdmamentioning

confidence: 99%

“…This is a key requirement of storage protocols such as iSCSI and its extensions for RDMA [6] (iSER), where the binding between a memory buffer and the physical memory backing it is not known until the time of I/O. The FAST-REGISTER MEMORY REGION and BIND MEMORY WINDOW APIs developed for this purpose, split the process of registration in two parts; the allocation of NIC resources, such as TLB entries, protection checks, etc.…”

Section: Related Workmentioning

confidence: 99%

Memory Management Support for Multi-Programmed Remote Direct Memory Access (RDMA) Systems

Magoutis

2005

2005 IEEE International Conference on Cluster Computing

View full text Add to dashboard Cite

show abstract

High Performance RDMA Protocols in HPC

Woodall

Shipman

Bosilca

et al. 2006

Recent Advances in Parallel Virtual Machine and Message Passing Interface

View full text Add to dashboard Cite

Modern network interconnects that leverage Remote Directory Memory Access (RDMA) and OS bypass, such as Infiniband [2], Myrinet [9], and iWARP over TCP [3], can offer significant performance advantages over conventional send/receive network semantics. However, the high performance of RDMA often comes with hidden costs. RDMA based interconnects generally fail to provide true one-sided semantics, requiring an exchange of information prior to initiating a one-sided RDMA operation. In addition, both the initiator and target must typically preserve the physical to virtual memory mappings during the RDMA operation. This paper describes a unique user-level 'pipeline' protocol that addresses these constraints while avoiding some of the pitfalls of existing techniques. By effectively overlapping the cost of memory registration with RDMA operations this protocol provides good performance even in the absence of memory buffer reuse. This protocol may also take advantage of memory buffers that have already been used in RDMA operations by avoiding the cost of memory registration. Through this approach, bandwidth may be increased up to 67% when memory buffers are not effectively reused while providing performance equal to that of existing techniques as demonstrated by both Linpack and NPB benchmark results. Several user level protocols are explored using Open MPI's PML (Point to point messaging layer) and compared/contrasted to this 'pipeline' protocol.

show abstract

A study of iSCSI extensions for RDMA (iSER)

Cited by 23 publications

References 3 publications

EDOS: Employing Mini-DB for High Semantic Object Store

EDOS: Employing Mini-DB for High Semantic Object Store

Memory Management Support for Multi-Programmed Remote Direct Memory Access (RDMA) Systems

High Performance RDMA Protocols in HPC

Contact Info

Product

Resources

About