Performance of RDMA-capable storage protocols on wide-area network

Yu, Weikuan; Rao, Nageswara S. V.; Wyckoff, P.; Vetter, Jeffrey S.

doi:10.1109/pdsw.2008.4811885

Cited by 14 publications

(7 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These evaluations rely on IB extension devices which limit WAN performance to approximately 8 Gbs, whereas our approach shows that RoCE can easily saturate existing 10G networks. Other related work has investigated RDMA-capable storage protocols over WANs [29] and explored system-level benefits of RDMA interfaces over 10G networks [9]. More recently there has been work to make a file transfer tool based on RDMA verbs [26].…”

Section: Related Workmentioning

confidence: 99%

Efficient wide area data transfer protocols for 100 Gbps networks and beyond

Kissel

Swany

Tierney

et al. 2013

Proceedings of the Third International Workshop on Network-Aware Data Management

View full text Add to dashboard Cite

Due to a number of recent technology developments, now is the right time to re-examine the use of TCP for very large data transfers. These developments include the deployment of 100 Gigabit per second (Gbps) network backbones, hosts that can easily manage 40 Gbps, and higher, data transfers, the Science DMZ model, the availability of virtual circuit technology, and wide-area Remote Direct Memory Access (RDMA) protocols. In this paper we show that RDMA works well over wide-area virtual circuits, and uses much less CPU than TCP or UDP. We also characterize the limitations of RDMA in the presence of other tra c, including competing RDMA flows. We conclude that RDMA for Science DMZ to Science DMZ transfers of massive data is a viable and desirable option for high-performance data transfer.

show abstract

Section: Related Workmentioning

confidence: 99%

Efficient wide area data transfer protocols for 100 Gbps networks and beyond

Kissel

Swany

Tierney

et al. 2013

Proceedings of the Third International Workshop on Network-Aware Data Management

View full text Add to dashboard Cite

show abstract

“…The one-sided semantics of RDMA READ/WRITE is a better choice for high-speed large-scale data transfer because it can decouple the data transfer entirely from the kernel software of the host operation system. Other researchers [17], [18] demonstrated that even though there are some benefits of using RDMA over LAN and WAN with short latency, there are challenges in achieving good performance in WAN with a long latency due to the problem of its low performance with RDMA READ operation. Based on these related works and their prior studies [16], [17], [18], our middleware is designed to exploit the full benefit of the RDMA by using RDMA WRITE operation yielding better performance and lower communication cost for synchronizing senders and receivers.…”

Section: Related Workmentioning

confidence: 99%

Protocols for wide-area data-intensive applications: Design and performance issues

Ren¹,

Li²,

Yu³

et al. 2012

2012 International Conference for High Performance Computing, Networking, Storage and Analysis

View full text Add to dashboard Cite

Abstract-Providing high-speed data transfer is vital to various data-intensive applications. While there have been remarkable technology advances to provide ultra-high-speed network bandwidth, existing protocols and applications may not be able to fully utilize the bare-metal bandwidth due to their inefficient design. We identify the same problem remains in the field of Remote Direct Memory Access (RDMA) networks. RDMA offloads TCP/IP protocols to hardware devices. However, its benefits have not been fully exploited due to the lack of efficient software and application protocols, in particular in wide-area networks. In this paper, we address the design choices to develop such protocols. We describe a protocol implemented as part of a communication middleware. The protocol has its flow control, connection management, and task synchronization. It maximizes the parallelism of RDMA operations. We demonstrate its performance benefit on various local and wide-area testbeds, including the DOE ANI testbed with RoCE links and InfiniBand links.

show abstract

“…The work on NFS over RDMA demonstrates better performance [44] because of the benefits of RDMA in several scenarios. Several researchers [45], [46], [47], [35] have investigated various aspects of the performance characteristics over IB WAN.…”

Section: Related Workmentioning

confidence: 99%