QETL: An approach to on-demand ETL from non-owned data sources

Baldacci, Lorenzo; Golfarelli, Matteo; Graziani, Simone; Rizzi, Stefano

doi:10.1016/j.datak.2017.09.002

Cited by 18 publications

(12 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…In the near future, we intend to study the efficiency of analyses on Unified Cubes built from largescale data. We plan to combine Unified Cube with on-demand ETL techniques [4] to materialize up-to-date data according to decision-makers' analysis needs at querying time. One long-term perspective consists of automatically synchronizing a Unified Cube with schema evolutions in the data sources.…”

Section: Resultsmentioning

confidence: 99%

“…No effective technique is proposed to guarantee the freshness of warehoused LOD presented to decision-makers during analyses. One promising avenue is to extend on-demand ETL processes [4] to fit for the integration of LOD in a DW at right time during business analyses. Otherwise, current ETL-based approaches are not suitable in today's highly dynamic context where large amounts of data are constantly published and updated; they collide with the distributed nature and the high volatility of LOD [24,17].…”

Section: Related Workmentioning

confidence: 99%

“…To discover more geographical granularities, the decision-maker looks into another dataset named LOD2. This dataset is managed by the Office for National Statistics of the UK 4 ; it associates several areas (including districts) with one corresponding region (cf. figure 1(c)).…”

Section: Introductionmentioning

confidence: 99%

“…http://www.w3.org/TR/vocab-data-cube4 https://www.ons.gov.uk/ 5 http://opendatacommunities.org/sparql 6 http://statistics.data.gov.uk/sparql…”

mentioning

confidence: 99%

See 3 more Smart Citations

A Unified Approach to Multisource Data Analyses

Ravat

Song

2018

View full text Add to dashboard Cite

Classically, Data Warehouses (DWs) supports business analyses on data coming from the inside of an organization. Nevertheless, Lined Open Data (LOD) might sensibly complete these business analyses by providing complementary perspectives during a decision-making process. In this paper, we propose a conceptual modeling solution, named Unified Cube, which blends together multidimensional data from DWs and LOD datasets without materializing them in a stationary repository. We complete the conceptual modeling with an implementation framework which manages the relations between a Unified Cube and multiple data sources at both schema and instance levels. We also propose an analysis processing process which queries different sources in a transparent way to decision-makers. The practical value of our proposal is illustrated through real-world data and benchmarks.

show abstract

Section: Resultsmentioning

confidence: 99%

Section: Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

“…http://www.w3.org/TR/vocab-data-cube4 https://www.ons.gov.uk/ 5 http://opendatacommunities.org/sparql 6 http://statistics.data.gov.uk/sparql…”

mentioning

confidence: 99%

See 2 more Smart Citations

A Unified Approach to Multisource Data Analyses

Ravat

Song

2018

View full text Add to dashboard Cite

show abstract

“…The ETL process was not considered in both studies. The second category of approaches handle this issue like [20] which proposes an incremental fetching and storing of LOD and other external resources on-demand. An ETL process is defined to load external data.…”

Section: Dw Design From Internal and External Sourcesmentioning

confidence: 99%

LOD for Data Warehouses: Managing the Ecosystem Co-Evolution

Khouri

Bellatreche

2018

Information

View full text Add to dashboard Cite

For more than 30 years, data warehouses (DWs) have attracted particular interest both in practice and in research. This success is explained by their ability to adapt to their evolving environment. One of the last challenges for DWs is their ability to open their frontiers to external data sources in addition to internal sources. The development of linked open data (LOD) as external sources is an excellent opportunity to create added value and enrich the analytical capabilities of DWs. However, the incorporation of LOD in the DW must be accompanied by careful management. In this paper, we are interested in managing the evolution of DW systems integrating internal and external LOD datasets. The particularity of LOD is that they contribute to evolving the DW at several levels: (i) source level, (ii) DW schema level, and (iii) DW design-cycle constructs. In this context, we have to ensure this co-evolution, as conventional evolution approaches are adapted neither to this new kind of source nor to semantic constructs underlying LOD sources. One way of tackling this co-evolution issue is to ensure the traceability of DW constructs for the whole design cycle. Our approach is tested using: the LUBM (Lehigh University BenchMark), different LOD datasets (DBepedia, YAGO, etc.), and Oracle 12c database management system (DBMS) used for the DW deployment.

show abstract

LOD Query-Logs as an Asset for Multidimensional Modeling

Khouri

Bellatreche

2018

Communications in Computer and Information Science

View full text Add to dashboard Cite

QETL: An approach to on-demand ETL from non-owned data sources

Cited by 18 publications

References 18 publications

A Unified Approach to Multisource Data Analyses

A Unified Approach to Multisource Data Analyses

LOD for Data Warehouses: Managing the Ecosystem Co-Evolution

LOD Query-Logs as an Asset for Multidimensional Modeling

Contact Info

Product

Resources

About