W3P: Building an OPM based provenance model for the Web

Freitas, André; Knap, Tomáš; Ó’Riain, Seán; Curry, Edward

doi:10.1016/j.future.2010.10.010

Cited by 20 publications

(11 citation statements)

References 26 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Readers can navigate through a workflow descriptor for the printing CO2 emissions on the Web. 6 The final average linear workflow size of the high-level workflow consisted of 4 processes and 5 artifacts. One important aspect for a provenance model is the expressivity of the queries supported by it.…”

Section: Discussionmentioning

confidence: 99%

“…This feature impacts both requirements (6) availability of different abstraction levels and (1) prospective and retrospective descriptions. Similar hierarchical features extending OPM were also targeted in [6]. Figure 2 depicts the core of the OPMV workflow model and the workflow extension of the Cogs vocabulary (marked with the cogs namespace).…”

Section: Cogs: a Vocabulary For Representing Etl Provenancementioning

confidence: 99%

See 1 more Smart Citation

Representing Interoperable Provenance Descriptions for ETL Workflows

Freitas

Kämpgen

Oliveira

et al. 2015

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

Abstract. The increasing availability of data on the Web provided by the emergence of Web 2.0 applications and, more recently by Linked Data, brought additional complexity to data management tasks, where the number of available data sources and their associated heterogeneity drastically increases. In this scenario, where data is reused and repurposed on a new scale, the pattern expressed as Extract-Transform-Load (ETL) emerges as a fundamental and recurrent process for both producers and consumers of data on the Web. In addition to ETL, provenance, the representation of source artifacts, processes and agents behind data, becomes another cornerstone element for Web data management, playing a fundamental role in data quality assessment, data semantics and facilitating the reproducibility of data transformation processes. This paper proposes the convergence of these two Web data management concerns, introducing a principled provenance model for ETL processes in the form of a vocabulary based on the Open Provenance Model (OPM) standard and focusing on the provision of an interoperable provenance model for ETL environments. The proposed ETL provenance model is instantiated in a real-world sustainability reporting scenario.

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Cogs: a Vocabulary For Representing Etl Provenancementioning

confidence: 99%

Representing Interoperable Provenance Descriptions for ETL Workflows

Freitas

Kämpgen

Oliveira

et al. 2015

Lecture Notes in Computer Science

Self Cite

View full text Add to dashboard Cite

show abstract

“…Their profile comprises artifact and process types and graph patterns to describe communications in distributed systems. Similarly, Freitas et al introduce types of processes, artifacts and agents to describe data publication over the Web [6].…”

Section: Related Workmentioning

confidence: 99%

A Formal Account of the Open Provenance Model

2015

View full text Add to dashboard Cite

The Open Provenance Model (OPM) is a community data model for provenance that is designed to facilitate the meaningful interchange of provenance information between systems. Underpinning OPM, is a notion of directed graph, used to represent data products and processes involved in past computations, and dependencies between them; it is complemented by inference rules allowing new dependencies to be derived. The Open Provenance Model was designed from requirements captured in two "Provenance Challenges", and tested during the third: these challenges were international, multi-disciplinary activities aiming to exchange provenance information between multiple systems and query it. The design of OPM was mostly driven by practical and pragmatic considerations. The purpose of this paper is to formalize the theory underpinning this data model. Specifically, this paper proposes a temporal semantics for OPM graphs, defined in terms of a set of ordering constraints between time-points associated with OPM constructs. OPM inferences are characterized with respect to this temporal semantics, and a novel set of patterns is introduced to establish soundness and completeness properties. Building on this novel foundation, the paper proposes new definitions for graph algebraic operations, graph refinement and the notion of account, by which multiple descriptions of a same execution are allowed to co-exist in a same graph. Overall, this paper provides a strong theoretical underpinning to a data model being adopted by a community of users that help its disambiguation and promote inter-operability.

show abstract

“…• Data Catalogue and Provenance service [11] to query the catalogue about data sources with specific attributes such as freshness and publisher, and track data back to its origin.…”

Section: Support Servicesmentioning

confidence: 99%