An information-theoretic approach to quantitative association rule mining

Abstract

Abstract. Quantitative Association Rule (QAR) mining has been recognized an influential research problem over the last decade due to the popularity of quantitative databases and the usefulness of association rules in real life. Unlike Boolean Association Rules (BARs), which only consider boolean attributes, QARs consist of quantitative attributes which contain much richer information than the boolean attributes. However, the combination of these quantitative attributes and their value intervals always gives rise to the generation of an explosively large number of itemsets, thereby severely degrading the mining efficiency.In this paper, we propose an information-theoretic approach to avoid unrewarding combinations of both the attributes and their value intervals being generated in the mining process. We study the mutual information between the attributes in a quantitative database and devise a normalization on the mutual information to make it applicable in the context of QAR mining. To indicate the strong informative relationships among the attributes, we construct a mutual information graph (MI graph), whose edges are attribute pairs that have normalized mutual information no less than a predefined information threshold. We find that the cliques in the MI graph represent a majority of the frequent itemsets. We also show that frequent itemsets that do not form a clique in the MI graph are those whose attributes are not informatively correlated to each other. By utilizing the cliques in the MI graph, we devise an efficient algorithm that significantly reduces the number of value intervals of the attribute sets to be joined during the mining process. Extensive experiments show that our algorithm speeds up the mining process by up to two orders of magnitude. Most importantly, we are able to obtain most of the highconfidence QARs, whereas the QARs that are not returned by MIC are shown to be less interesting.

Object-oriented spatial-temporal association rules mining on ocean remote sensing imagery

“…When implementing QARM, attributes are quantitative numeric values not boolean one, so the quantitative association rules are far more expressive and informative than boolean association rules [15]. The continuous value in remote sensing imagery is discretized into five continuous levels which represent sever changes, slight changes and no changes.…”

“…The NOMI can get rid of the localness and make the normalized mutual information a global measure [15].…”

Novel Algorithm for Mining ENSO-Oriented Marine Spatial Association Patterns from Raster-Formatted Datasets

“…To reduce the number of database scans, many algorithms have been developed in recent decades. Considering that database scans mostly depend on the numbers of frequent 1-itemsets, mutual information is used to pre-extract the pair-wise related items and to then find all frequent itemsets [13,14]. By first filtering the unrelated 1-itemsets, the mutual-information-based algorithms greatly reduce the number of database scans and thus improve the implementation efficiency [15].…”

Normalized-Mutual-Information-Based Mining Method for Cascading Patterns

“…Normalized mutual information is the amount of information one item (X) provides about another (Y) [21], as shown in Equations (1)- (3).…”

“…Normalized mutual information tells the amount of information one item provides about the other [20]. As an asymmetry, normalized mutual information can produce the causal effect relationship between items, which has been widely used to find associated or correlated patterns in data mining [21][22][23][24]. However, in real applications, the cascading pattern, in a form of "X 1 → X 2 → .…”