vSocket: virtual socket interface for RDMA in public clouds

Wang, Dongyang; Fu, Binzhang; Lü, Gang; Tan, Kun; Hua, Bin

doi:10.1145/3313808.3313813

Cited by 11 publications

(13 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…2) Virtualization-aware solutions: More recently, VSocket [57] and SocksDirect [58] proposed a more integrated approach specifically designed for virtualized environments, with the goal of integrating in the same library the POSIX interface and the I/O virtualization mechanisms. These works forward socket calls from the virtualized application directly to the provider-managed physical host, although in a different way.…”

Section: B Standard Posix Apimentioning

confidence: 99%

“…These works forward socket calls from the virtualized application directly to the provider-managed physical host, although in a different way. On the one hand, VSocket [57] targets socket-based applications running in VMs. For each intercepted network packet, VSocket performs one payload copy from the application to a library buffer on the sender side, and vice versa on the receive side.…”

Section: B Standard Posix Apimentioning

confidence: 99%

“…Notable exceptions include nethuns [112] and INSANE [113], which ease these requirements and can work with regular hardwarebased virtualization (see Section II-D1). VSocket [57] and SocksDirect [58] take a step further and propose an integrated solution for I/O virtualization, as discussed in the next Section.…”

Section: Key Takeawaysmentioning

confidence: 99%

See 2 more Smart Citations

Empowering Cloud Computing With Network Acceleration: A Survey

Rosa,

Foschini,

Corradi

2024

IEEE Commun. Surv. Tutorials

View full text Add to dashboard Cite

Modern interactive and data-intensive applications must operate under demanding time constraints, prompting a shift toward the adoption of specialized software and hardware network acceleration technologies. This specialization, however, poses significant scalability, flexibility, security, and economic sustainability challenges for application developers. Cloud computing holds the potential to overcome these obstacles by offering the cost-effective option to access specialized acceleration technologies through standard cloud interfaces. Nevertheless, that integration is still challenging for cloud providers. In the cloud, physical resources are hidden behind a virtualization layer, whereas acceleration technologies make applications directly interact with the hardware. To bridge this gap, recent literature explores the possibility of empowering cloud platforms with accelerated networking as a commodity, thus offering the innovative option of Network Acceleration as a Service. This survey reviews these recent research efforts by adopting popular technologies like XDP, DPDK, and RDMA as a reference. To organize the surveyed research in a comprehensive framework, we identify four key aspects that pose critical problems to the integration of acceleration options in cloud computing -access interfaces, virtualization techniques, serviceability, and security -and systematically discuss the associated challenges. Then, we present the issues to be further addressed and outline the most promising research directions for the full integration of network acceleration within next-generation cloud computing platforms.

show abstract

Section: B Standard Posix Apimentioning

confidence: 99%

Section: B Standard Posix Apimentioning

confidence: 99%

See 1 more Smart Citation

Empowering Cloud Computing With Network Acceleration: A Survey

Rosa,

Foschini,

Corradi

2024

IEEE Commun. Surv. Tutorials

View full text Add to dashboard Cite

show abstract

“…An RDMA-to-the-VM method has been adopted in vSocket [35] to avoid packet copy in the Rx path. Comprehensive vSocket framework has been provided to apply the RDMA technology to virtualized applications in public clouds, and they receive performance benefits of RDMA via dedicated virtual packet I/O.…”

Section: B Round-2: Analyzing Performance Characteristicsmentioning

confidence: 99%

Software Physical/Virtual Rx Queue Mapping Toward High-Performance Containerized Networking

Kawashima

2021

IEEE Trans. Netw. Serv. Manage.

View full text Add to dashboard Cite

Softwarization of Network Functions (NFs) accelerates automated deployment and management of services on nextgen networks. Combining flexibility and high-performance is a vital requirement for Network Functions Virtualisation (NFV); however, many studies have demonstrated that containerization or virtualization of NFs severely degrades the fundamental efficiency of packet forwarding. Virtual network I/O, a mechanism of packet transferring between a guest and the host, has been seen as the performance bottleneck in the PVP (Physical-Virtual-Physical) datapath, and one of the main causes of this deterioration is packet copy between them. Various techniques, such as zero-copy, pass-through, and hardware offloading, have been examined to alleviate the performance overhead. However, existing designs and implementations incur pragmatic issues, such as compatibility, manageability, and insufficient quality of performance. We propose yet another design and implementation of zero-copy/pass-through acceleration (named IOVTee) to resolve real-world problems as well as to enhance the forwarding efficiency. IOVTee takes advantage of pre-processing of virtual switches with achieving zero-copy on the receive (Rx) path. The pluggable style of IOVTee for vhost-user (the de-facto virtual network I/O) enables our approach to be transparent to both containers/VMs and virtual switches. In this paper, we explain the heart of IOVTee, a fully software-based Rx queue mapping mechanism (between physical and virtual) that enables a concept of Virtual DMA Write-through (to the NF). Our evaluation results showed that applying IOVTee to vhost-user drastically increased efficiency of packet forwarding in the PVP datapath (by 45% and 98% for traffic of 64-byte and 1514-byte packets respectively).

show abstract

“…Second, using faster networks like InfiniBand could alleviate the slow network problem but they are difficult to manage in virtualized environments. Existing RDMA virtualization solutions [11,49,56,67] are not mature enough [41] yet due to difficulty in orchestration, lack of migration support, high memory registration overheads, and so on [32]. Key insights and contributions: This paper proposes a novel concept, NVMe-oAF, which is inspired by HPC runtimes like MPI to accelerate the I/O data path for an application using shared memory while using the already existing TCP connection in the control path.…”

Section: Introductionmentioning

confidence: 99%

NVMe-oAF

Kashyap

2022

Proceedings of the 31st International Symposium on High-Performance Parallel and Distributed Computing

View full text Add to dashboard Cite

Applications running inside containers or virtual machines, traditionally use TCP/IP for communication in HPC clouds and data centers. The TCP/IP path usually becomes a major performance bottleneck for applications performing NVMe-over-Fabrics (NVMe-oF) based I/O operations in disaggregated storage settings. We propose an adaptive communication channel, called NVMe-over-Adaptive-Fabric (NVMe-oAF), that applications could leverage to eliminate the high-latency and low-bandwidth incurred by remote I/O requests over TCP/IP. NVMe-oAF accelerates I/O intensive applications using locality awareness along with optimized shared memory and TCP/IP paths. The adaptiveness of the fabric stems from the ability to adaptively select shared memory or TCP channel and further applying optimizations for the chosen channel. To evaluate NVMe-oAF, we co-design Intel's SPDK library with our designs and show up to 7.1x bandwidth improvement and up to 4.2x latency reduction for various workloads over commodity TCP/IPbased Ethernet networks (e.g., 10Gbps, 25Gbps, and 100Gbps). We achieve similar (or sometimes better) performance when compared to NVMe-over-RDMA by avoiding the cumbersome management of RDMA in HPC cloud environments. Finally, we also co-design NVMe-oAF with H5bench to showcase the benefit it brings to HDF5 applications. Our evaluation indicates up to a 7x bandwidth improvement when compared with the network file system (NFS).

show abstract

vSocket: virtual socket interface for RDMA in public clouds

Cited by 11 publications

References 9 publications

Empowering Cloud Computing With Network Acceleration: A Survey

Empowering Cloud Computing With Network Acceleration: A Survey

Software Physical/Virtual Rx Queue Mapping Toward High-Performance Containerized Networking

NVMe-oAF

Contact Info

Product

Resources

About