Distributed Spatial-Keyword kNN Monitoring for Location-aware Pub/Sub

Abstract

Recent applications employ publish/subscribe (Pub/Sub) systems so that publishers can easily receive attentions of customers and subscribers can monitor useful information generated by publishers. Due to the prevalence of smart devices and social networking services, a large number of objects that contain both spatial and keyword information have been generated continuously, and the number of subscribers also continues to increase. This poses a challenge to Pub/Sub systems: they need to continuously extract useful information from massive objects for each subscriber in real time.In this paper, we address the problem of 𝑘 nearest neighbor monitoring on a spatial-keyword data stream for a large number of subscriptions. To scale well to massive objects and subscriptions, we propose a distributed solution, namely D𝑘M-SKS. Given 𝑚 workers, D𝑘M-SKS divides a set of subscriptions into 𝑚 disjoint subsets based on a cost model so that each worker has almost the same 𝑘NN-update cost, to maintain load balancing. D𝑘M-SKS allows an arbitrary approach to updating 𝑘NN of each subscription, so with a suitable in-memory index, D𝑘M-SKS can accelerate update efficiency by pruning irrelevant subscriptions for a given new object. We conduct experiments on real datasets, and the results demonstrate the efficiency and scalability of D𝑘M-SKS.