Scalable Mining of High-Utility Sequential Patterns With Three-Tier MapReduce Model

Abstract

High-utility sequential pattern mining (HUSPM) is a hot research topic in recent decades since it combines both sequential and utility properties to reveal more information and knowledge rather than the traditional frequent itemset mining or sequential pattern mining. Several works of HUSPM have been presented but most of them are based on main memory to speed up mining performance. However, this assumption is not realistic and not suitable in large-scale environments since in real industry, the size of the collected data is very huge and it is impossible to fit the data into the main memory of a single machine. In this article, we first develop a parallel and distributed three-stage MapReduce model for mining high-utility sequential patterns based on large-scale databases. Two properties are then developed to hold the correctness and completeness of the discovered patterns in the developed framework. In addition, two data structures called sidset and utility-linked list are utilized in the developed framework to accelerate the computation for mining the required patterns. From the results, we can observe that the designed model has good performance in large-scale datasets in terms of runtime, memory, efficiency of the number of distributed nodes, and scalability compared to the serial HUSP-Span approach.

MCoR-Miner: Maximal Co-Occurrence Nonoverlapping Sequential Rule Mining

“…In addition, to discover missing events, negative SPM methods such as e-NSP [45] and e-RNSP [46] were designed. An approach called high utility SPM was also designed [47,48], which can discover patterns with low frequency but high utility [49,50].…”

Utilizing power consumption and SLA violations using dynamic VM consolidation in cloud data centers

“…Many individuals and businesses worldwide use Cloud Computing (CC) [1][2][3] to obtain storage and computing services accessible via the Internet. The general use of cloud computing has increased manifold due to its easy accessibility, excellent scalability, cost efficiency, and reliability [4][5][6].…”