Handling catastrophic failures in scalable Internet applications

Abstract

User perceived quality is the most important aspect of Internet applications. After a single negative experience, users tend to switch to one of the other myriad of alternatives available to them on the Internet. Two key components of Internet application quality are scalability and reliability. In this paper, we present the first general-purpose mechanism capable of maintaining reliability in the face of process, machine, and catastrophic failures. We define catastrophic failures as events that cause entire clusters of servers to become unavailable such as network partitioning, router failures, natural disasters, or even terrorist attacks. Our mechanism utilizes client-side tunneling, clientside redirection, and implicit redirection triggers to deliver reliable communication channels. We capitalize on previous work, Redirectable Sockets (RedSocks), that focuses on Internet application scalability. RedSocks are communication channels enhanced with a novel session layer aimed at modernizing network communication. We modify RedSocks to create the first fault tolerant socket solution that can handle all server-side failures. Our mechanism is compatible with NATs and Firewalls, scalable, application independent, and backwards compatible.

A scalable NAT‐based solution to Internet access denial by higher‐tier ISPs

“…Most of the research that has been done in this area targets DoS attacks and security breaches [11][12][13][14]. Only few research efforts targeted terrorist attacks and intentional hardware failures [15,16].…”

Resilient Routing Layers for Network Disaster Planning

“…A catastrophe will cause stress in the Internet, and access and admission control methods have been developed that can be beneficial after a disaster [7]. At the transport level special socket communication that is reliable also in the case of catastrophic failures is reported in [8].…”