Maintaining data warehouses over changing information sources

Rundensteiner, Elke A.; Koeller, Andreas; Zhang, Xin

doi:10.1145/336460.336475

Cited by 104 publications

(43 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Consequently, such systems tend to be useful only when the community of member databases is small and stable. Indeed, it is commonly agreed upon in this field and the related field of data warehousing that future research should find ways to automate the integration and maintenance process [14,25].…”

Section: Introductionmentioning

confidence: 99%

Autoplex: Automated Discovery of Content for Virtual Databases

Berlin

Motro

2001

Cooperative Information Systems

View full text Add to dashboard Cite

Abstract. Most virtual database systems are suitable for environments in which the set of member information sources is small and stable. Consequently, present virtual database systems do not scale up very well. The main reason is the complexity and cost of incorporating new information sources into the virtual database. In this paper we describe a system, called Autoplex, which uses machine learning techniques for automating the discovery of new content for virtual database systems. Autoplex assumes that several information sources have already been incorporated ("mapped") into the virtual database system by human experts (as done in standard virtual database systems). Autoplex learns the features of these examples. It then applies this knowledge to new candidate sources, trying to infer views that "resemble" the examples. In this paper we report initial results from the Autoplex project.

show abstract

Section: Introductionmentioning

confidence: 99%

Autoplex: Automated Discovery of Content for Virtual Databases

Berlin

Motro

2001

Cooperative Information Systems

View full text Add to dashboard Cite

show abstract

“…One of the first solution of this problem is Evolvable View Environment (EVE) Rundensteiner et al 2000;Rundensteiner et al 1999). EVE is an environment that allows to detect an ETL workflow that is implemented by means of views.…”

Section: Related Workmentioning

confidence: 99%

ETL workflow reparation by means of case-based reasoning

Wojciechowski

2017

Inf Syst Front

View full text Add to dashboard Cite

Data sources (DSs) being integrated in a data warehouse frequently change their structures/schemas. As a consequence, in many cases, an already deployed ETL workflow stops its execution, yielding errors. Since in big companies the number of ETL workflows may reach dozens of thousands and since structural changes of DSs are frequent, an automatic repair of an ETL workflow after such changes is of high practical importance. In our approach, we developed a framework, called E-ETL, for handling the evolution of an ETL layer. In the framework, an ETL workflow is semi-automatically or automatically (depending on a case) repaired as the result of structural changes in DSs, so that it works with the changed DSs. E-ETL supports two different repair methods, namely: (1) user defined rules, (2) and Case-Based Reasoning. In this paper, we present how Case-Based Reasoning may be applied to repairing ETL workflows. In particular, we contribute an algorithm for selecting the most suitable case for a given ETL evolution problem. The algorithm applies a technique for reducing cases in order to make them more universal and capable of solving more problems. The algorithm has been implemented in prototype E-ETL and evaluated experimentally. The obtained results are also discussed in this paper.

show abstract

“…(3), the data sources used in artifacts data model consist of age, morphology, geographic area, nature, purpose, completeresidual extent, source, value, unit, rank, etc. These data sources correspond to the appropriate dimension tables, which connect to the antique fact table through its code to generate the artifacts cube data model [8,9].…”

Section: Multidimensional Data Modelmentioning

confidence: 99%

Multidimensional Analysis of Distributed Data Warehouse of Antiquity Information

Sun¹,

Qi²,

Li³

2015

TOCSJ

View full text Add to dashboard Cite

Abstract:Aiming at the problems in the management and sharing research of antique information, this paper discussed the necessity to build antique information distributed data warehouse. The data warehouse architecture and the multidimensional data model were put forward, by usingonline analysis processing (OLAP) the multidimensional analysis of antique distributed data warehouse was presented, and a multidimensional analysis process was given. By multidimensional analysis of the distributed data warehouse, the accessing and analyzing platform was provided for antique managers and researchers to provide strong support for the work of antique information management and sharing.

show abstract

Maintaining data warehouses over changing information sources

Cited by 104 publications

References 7 publications

Autoplex: Automated Discovery of Content for Virtual Databases

Autoplex: Automated Discovery of Content for Virtual Databases

ETL workflow reparation by means of case-based reasoning

Multidimensional Analysis of Distributed Data Warehouse of Antiquity Information

Contact Info

Product

Resources

About