CommonCube-based Conceptual Modeling of ETL Processes

Li, Zehai; Sun, Jun; Yu, Hongfeng; Zhang, Jian

doi:10.1109/icca.2005.1528104

Cited by 6 publications

(3 citation statements)

References 6 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In addition, the simplicity of conceptual models promotes understanding even by non-technical users, and ensures the simplicity of founding a logical model and implementing it efficiently. Indeed, the authors in [31] asserted that it is imperative to employ a simple conceptual model, in order to (i) provide powerful modeling methods to facilitate smooth redefinition and revision efforts; (ii) reflect the schema of both the data sources and the target DW explicitly; and (iii) serve as the means of communication with the executing phase of an ETL process. Moreover, even the authors of the synthesized contributions detailed a case study or demonstration example, in order to prove the feasibility of the proposed models.…”

Section: Discussion and Findingsmentioning

confidence: 99%

“…In this section, we propose a new categorization of the studied research works. As follows from Figure 1, we categorize these chronologically sorted research works into six main classes, according to the modeling formalism on which they are based: (i) Model based on UML [22]; (ii) model based on ontology [23]; (iii) model based on MDA [24] and model-driven development (MDD) [25]; (iv) model based on graphical flow formalism, including BPMN [26], the CPN modeling language [27], YAWL (Yet Another Workflow Language) [28], and data flow visualization [29]; (v) model based on ad hoc formalisms, including conceptual constructs [30], CommonCube [31], and EMD [32]; and, finally, (vi) contributions dealing with Big Data.…”

Section: Proposed Classification Of Etl/elt Process Modeling Approachesmentioning

confidence: 99%

“…In [31], Zehai et al proposed a conceptual model for the ETL processes, providing formal definitions and descriptions of ETL entities such as data source, data target, ETL function, ETL task, ETL session, and so on. They used CommonCubes to represent the schemas of data cubes in a target DW.…”

Section: Summary Of Etl Process Modeling Approaches Based On Commoncubementioning

confidence: 99%

See 2 more Smart Citations

Data Warehousing Process Modeling from Classical Approaches to New Trends: Main Features and Comparisons

Dhaouadi

Bousselmi

Gammoudi

et al. 2022

Data

View full text Add to dashboard Cite

The extract, transform, and load (ETL) process is at the core of data warehousing architectures. As such, the success of data warehouse (DW) projects is essentially based on the proper modeling of the ETL process. As there is no standard model for the representation and design of this process, several researchers have made efforts to propose modeling methods based on different formalisms, such as unified modeling language (UML), ontology, model-driven architecture (MDA), model-driven development (MDD), and graphical flow, which includes business process model notation (BPMN), colored Petri nets (CPN), Yet Another Workflow Language (YAWL), CommonCube, entity modeling diagram (EMD), and so on. With the emergence of Big Data, despite the multitude of relevant approaches proposed for modeling the ETL process in classical environments, part of the community has been motivated to provide new data warehousing methods that support Big Data specifications. In this paper, we present a summary of relevant works related to the modeling of data warehousing approaches, from classical ETL processes to ELT design approaches. A systematic literature review is conducted and a detailed set of comparison criteria are defined in order to allow the reader to better understand the evolution of these processes. Our study paints a complete picture of ETL modeling approaches, from their advent to the era of Big Data, while comparing their main characteristics. This study allows for the identification of the main challenges and issues related to the design of Big Data warehousing systems, mainly involving the lack of a generic design model for data collection, storage, processing, querying, and analysis.

show abstract

Section: Discussion and Findingsmentioning

confidence: 99%

Section: Proposed Classification Of Etl/elt Process Modeling Approachesmentioning

confidence: 99%

Section: Summary Of Etl Process Modeling Approaches Based On Commoncubementioning

confidence: 99%

See 1 more Smart Citation

Data Warehousing Process Modeling from Classical Approaches to New Trends: Main Features and Comparisons

Dhaouadi

Bousselmi

Gammoudi

et al. 2022

Data

View full text Add to dashboard Cite

show abstract

Heterogeneous Data Integration with ELT and Analytical MPP Database for Data Analysis Application

Sivabalan

Minu

2021

2021 Innovations in Power and Advanced Computing Technologies (I-Pact)

View full text Add to dashboard Cite

ETL Process Modeling Conceptual for Data Warehouses: A Systematic Mapping Study

Mufioz

Mazón

Trujillo

2011

IEEE Latin Am. Trans.

View full text Add to dashboard Cite

Abstract-BACKGROUND: A data warehouse (DW) is anintegrated collection of subject-oriented data in the support of decision making. Importantly, the integration of data sources is achieved through the use of ETL (Extract, Transform, and Load) processes. It is therefore extensively recognized that the appropriate design of the ETL processes are key factors in the success of DW projects. OBJECTIVE: We assess existing research proposals about ETL process modeling for data warehouse in order to identify their main characteristics, notation, and activities. We also study if these modeling approaches are supported by some kind of prototype or tool. METHOD: We have undertaken a systematic mapping study of the research literature about modeling ETL processes. A mapping study provides a systematic and objective procedure for identifying the nature and extent of the available research by means of research questions. RESULTS: The study is based on a comprehensive set of papers obtained after using a multi-stage selection criteria and are published in international workshops, conferences and journals between 2000 and 2009. CONCLUSIONS: This systematic mapping study states that there is a clear classification of ETL process modeling approaches, but that they are not enough covered by researchers. Therefore, more effort is required to bridge the research gap in modeling ETL processes. [15]. Estas herramientas se diseñan desde la perspectiva lógica y en la mayoría de los casos, presentan algunos inconvenientes: (i) falta de especificidad, (ii) dependencia de la plataforma destino, (iii) la configuración y estructura son muy complejas, (iv) requieren grandes requerimientos de hardware y, por lo tanto, no son factibles para pequeños y medianos proyectos. Estas características pueden hacer difícil la integración en ambientes heterogéneos de ADs. Por estas razones y, además, por la larga curva de aprendizaje, y el alto costo de adquisición y mantenimiento, muchas organizaciones prefieren desarrollar sus propios procesos ETL. Keywords-Dada la importancia de los procesos ETL dentro del marco de desarrollo de ADs, en este artículo se pretende brindar una aproximación a través de un mapeo sistemático de estudios, de cuáles son los diferentes enfoques de modelado de procesos ETL, características relevantes de cada uno de ellos, actividades, notaciones y problemática presentada en cada enfoque. Es con esta motivación que el estudio actual ha surgido de nuestro trabajo para recopilar, mapear y resumir los estudios primarios sobre modelado conceptual de procesos ETL para AD de manera precisa [7]. Un mapeo sistemático ofrece una visión sistemática de un área de investigación y permite evaluar la cantidad de pruebas existentes sobre un tema de interés [7] (véase, por ejemplo de Bailey et al. mapeo de estudios [1]).El mapeo sistemático de estudios es una metodología que se utiliza con frecuencia en la investigación médica. El objetivo principal de un mapeo sistemático de estudios es

show abstract

CommonCube-based Conceptual Modeling of ETL Processes

Cited by 6 publications

References 6 publications

Data Warehousing Process Modeling from Classical Approaches to New Trends: Main Features and Comparisons

Data Warehousing Process Modeling from Classical Approaches to New Trends: Main Features and Comparisons

Heterogeneous Data Integration with ELT and Analytical MPP Database for Data Analysis Application

ETL Process Modeling Conceptual for Data Warehouses: A Systematic Mapping Study

Contact Info

Product

Resources

About