High-Performance Packet Routing Acceleration for Cloud Systems Using High Bandwidth Memory

Abstract

Virtual routers (vRouters) in cloud systems are in great demand due to the ever-increasing network bandwidth. To meet this demand, hardware offload technologies are mandatory for vRouters. Furthermore, offload hardware needs new architecture to achieve a throughput of several hundred Gbps, because memories that store routing tables will create a bottleneck. Therefore, we propose a new hardware architecture using high bandwidth memories (HBMs) and an acceleration engine equipped with multipipeline processing. In this paper, we improved the performance of the random memory-accesses from multiple pipelines by distributing to the memory channels of HBMs. In our prototype, vRouter packet processing performances were achieved 320 M packet per second(pps) and 250 Gbit per second (bps). Moreover, the prototype showed low and stable latency of packet transfers that was not affected by background traffic.