SSD-AIS: An Accurate and Invertible Sketch for Super Spread Detection

Abstract

Super spread detection has been widely applied in network management, recommender systems and cyber space security, which is more complicated than heavy hitter, owing to the requirement of duplicate removal. Accurately detecting super spread in real-time with small memory remains a nontrivial yet challenging issue. The previous work either had low accuracy or incurred heavy memory overhead and could not provide precise cardinality estimation. This paper designs an invertible sketch for super spread detection with small memory and high accuracy. It introduces a power-weakening increment strategy that create an environment encouraging sufficient competition at the early stages of discriminating super spread and amplifying the comparative dominance to maintain accuracy. Extensive experiments have been performed based on actual Internet traffic traces and recommender system dataset. The trace-driven evaluation demonstrates that our sketch actualizes higher accuracy in super spread detection than state-of-the-art sketches. The super spread cardinality estimation error is 2.6-19.6 times lower than that of the previous algorithms.