An Architecture for Integrated Online Analytical Mining

Abstract

Several works in the past proved the likelihood and interest of integrating Online Analytical Processing (OLAP) with data mining and as a result a new promising direction of Online Analytical Mining (OLAM) has emerged. In this paper, a variety of OLAM architectures in the literature were reviewed and the limitations in the previously reported work have been identified. Literature review reveals the fact that none of the previously reported OLAM architectures have integrated enhanced OLAP with data mining. This work is an attempt to enhance OLAP performance in terms of cube construction time and to improve visualization by providing interactive visual exploration of the data cube. The main aim of this paper is to propose an integrated OLAM architecture that not only overcomes the existing limitations but also extends the architecture by adding an automation layer for the schema generation. In the proposed work, hierarchical clustering has been used as the data mining technique and three types of warehouse schemas namely were automatically generated. A prototype of automatic schema generation has been developed and schema generation algorithms have been provided. In addition to this, we implemented and deployed the proposed architecture. Validation has been done by performing experiments on real life data set. Experimental results prove that the proposed architecture improves the cube construction time, empowers interactive data visualization, automate schema generation, and enable targeted analysis at the front-end. With this seamless integration a higher degree of improvement is achieved which makes significant advancement in the modern OLAM architectures

Olam

“…More recently several authors (e.g., [12,14,17]) exploited data mining algorithms during the DW design process to discover multidimensional schemata in a semi-automatic fashion. Although the OLAM concept has been sometimes adopted in this context too, we believe that OLAM must be strictly related to front-end functionalities made available to the users.…”

A Reactive Scheduling Strategy Applied On MapReduce OLAM Operators System

“…OLAM (also called OLAP Mining) is the coupling of OLAP with data mining in multidimensional databases (data warehouses) [1,2]. We can define a data warehouse as a dedicated database to store the set of used data in the context of decision making and decision analysis.…”

“…The idea of combining on-line analysis and data mining [1,2] is an effective solution to strengthen the process of decision support. Indeed, there are two areas that can be completed as part of a unified analysis process.…”

Enterprise Architecture Model that Enables to Search for Patterns of Statistical Information

“…Such systems became widely used in criminology (to find out relations between crimes and known delinquents who could potentially commit them [26]), in medicine (to search for correlations between groups of people with a certain missing part of the Y chromosome and clinical presentation of infertility [27]) and so on. However, in a general case discussed in this paper, when the structure and elements of searched-for patterns are not known beforehand, creating OLAM systems is an unacceptable approach.…”