Towards an open service architecture for data mining on the grid

Abstract

Across a wide variety of fields, huge datasets are being collected and accumulated at a dramatical pace. The datasets addressed by individual applications are very often heterogeneous and geographically distributed, and are used for collaboration by the communities of users, which are often large and also geographically distributed. There are major challenges involved in the efficient and reliable storage, fast processing, and extracting descriptive and predictive knowledge from this great mass of data. In this paper, we describe design principles and a service based software architecture of a novel infrastructure for distributed and high-performance data mining in Grid environments.

UDDI registry for Knowledge Discovery in Databases services

“…Open support environments proposed in the recent literature are based on open architecture like Grid [5,6,22,4] and SOA [16,15,11,1]. Such proposals are mainly focused on supporting the data mining phase.…”

An overlay network for autonomous information discovery in the post-composition registries of ambient networks

“…The clients must support the uniform query interface in order to be able to use the Grid-DBMS. In Brezany et al (2003) for instance, the clients must be able to discover and use the grid data service that allows access to the grid database. In Fu et al (2006), the client must support SQL.…”

Weka4WS: A WSRF-Enabled Weka Toolkit for Distributed Data Mining on Grids

“…Grids have been designed to support applications that can benefit from high performance, distribution, collaboration, data sharing and complex interaction of autonomous and geographically dispersed resources. Since computational Grids emerged as effective infrastructures for distributed high-performance computing and data processing, a few Grid-based KDD systems has been proposed [1,2,3,4]. By exploting a service-oriented approach, data-intensive and knowledge discovery applications can be developed by exploiting the Grid technology to deliver high performance and manage data and knowledge distribution.…”