On-line analytical processing on large databases managed by computational grids

Abstract

Management of large data repositories integrated into the Grid poses new challenges for Grid research.There already exist several successful Data Grid projects addressing processing files storing large volumes of scientific data and projects developing services for accessing remote relational and XML databases. However, so far, no effort was devoted to On-Line Analytical Processing (OLAP), an essential support for modern decision support systems. In this paper, we present our approach to the design and implementation of a Grid-enabled OLAP server, which is one functional building block of the GridMiner system, a novel infrastructure for knowledge discovery in Grid databases. We present the global architecture model of our solution, describe how the OLAP components are integrated into the GridMiner system, and present the software architecture of our first prototype. The OLAP components were implemented in Java on top of the software toolkit Globus 3.

Grid Computing Solutions for Distributed Repositories of Protein Folding and Unfolding Simulations

“…Grid data management technology is maturing and is able to support relatively sophisticated data analysis scenarios, as has been demonstrated by projects such as Gridminer [11] and the KnowledgeGrid [12], as well as the DataMiningGrid [5]. Unfortunately, the shipping of programs to data locations has not been investigated in as much detail, even though this is an important approach for distributed data sets that cannot be transferred to centralised processing facilities (due to either their large volume or their confidential nature).…”

The OLAP-Enabled Grid: Model and Query Processing Algorithms

“…A number of researchers have taken a software component oriented approach to the problem, by describing the services and middleware interactions which should exist in order to support OLAP [16,18,19]. In [20,21], Niemi et.…”

Towards Real-Time Data Transformation Services over Grids

“…This novel paradigm puts the basis for a wide class of innovative application scenarios ranging from Extraction-Transformation-Loading (ETL) processes over Grids to Grid-based Business Intelligence (BI) and Grid-based OnLine Analytical Processing (OLAP) [10,2,20,19]. Within the broader context of Data Warehousing Grid services, Data Transformation (DT) services over Grids are leading components of Grid Data Warehouses (GDWH) [17,8,6,21,25,26,28,4,29] (similarly to what happens in conventional architectures), and also meaningfully cope with basic Grid functionalities such as data-oriented autonomic computing, active behaviour paradigms, and data exchange tools.…”