ShockAbsorber: a TCP connection router

Abstract

ShockAbsorber is a software router of TCP connections that supports load sharing across multiple TCP servers that share a set of virtual IP addresses. It consists of the Executor, a O/S kernel extension that supports fast IP packet forwarding, and a user level Manager process that controls it. The Manager implements a novel dynamic load-sharing algorithm for allocation of TCP connections among servers according to their real-time load and responsiveness. This algorithm produces weights that are used by the Executor to quickly select a server for each new connection request. The Executor forwards client TCP packets t o the servers without performing any TCP/IP header translations. Outgoing server-to-client packets are not handled by ShockAbsorber and can follow a separate network route to the clients. Depending on the workload traffic, the performance benefit of this half-connection method can be significant. Prototypes of ShockAbsorber were used to scale up several large and high-load Internet sites serving millions of TCP connections per hour.

Improving the Efficiency of Cloud Infrastructures with Elastic Tandem Machines

“…A common principle is to first forwarded requests to a load balancer, which then directs the requests to machines from a pool of servers. Similar to our approach, this redirection can be performed by rewriting addresses, either IP addresses (network address translation (NAT), e.g., [8]) or MAC addresses (e.g., [9]). In contrast to most of these approaches, we avoid a dedicated load balancer and rather utilize available (core) switches together with an SDN controller to implement request redirection.…”

An efficient load balancing strategy for scalable WAP gateways

“…This half-connection forwarding method [5] is particularly useful for WAP services that are characterized by small sizes of client requests that may result in large sizes of responses. That is, the WAP client packets are typically very short, e.g.…”

Session awareness issues for next generation cluster based network load balancing frameworks

“…On the other hand, the state of the art network load balancing frameworks, such as LVS [10] and IBM Network Dispatcher [11], are exclusively flowaware. In order to ensure the reliable execution of services, these frameworks need to provide application level integrity.…”