2016
DOI: 10.1007/978-3-319-34129-3_16
|View full text |Cite
|
Sign up to set email alerts
|

Heaven: A Framework for Systematic Comparative Research Approach for RSP Engines

Abstract: Abstract. Benchmarks like LSBench, SRBench, CSRBench and, more recently, CityBench satisfy the growing need of shared datasets, ontologies and queries to evaluate window-based RDF Stream Processing (RSP) engines. However, no clear winner emerges out of the evaluation. In this paper, we claim that the RSP community needs to adopt a Systematic Comparative Research Approach (SCRA) if it wants to move a step forward. To this end, we propose a framework that enables SCRA for window based RSP engines. The contributi… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

0
9
0

Year Published

2016
2016
2023
2023

Publication Types

Select...
5
1
1

Relationship

4
3

Authors

Journals

citations
Cited by 10 publications
(9 citation statements)
references
References 28 publications
0
9
0
Order By: Relevance
“…The investigation related the validation problem develops in [46][47][48]. Validation research is comparative, and thus, it relies on the notion of experiment [28].…”
Section: Major Resultsmentioning
confidence: 99%
See 1 more Smart Citation
“…The investigation related the validation problem develops in [46][47][48]. Validation research is comparative, and thus, it relies on the notion of experiment [28].…”
Section: Major Resultsmentioning
confidence: 99%
“…To guarantee repeatability and reproducibility, researchers must have full control over both the experimental environment and the object of study. Thus, our main research contribution to solve the validation problem are (i) a methodology for experiment design for RSP [42] and the architecture for an experimental environment based on the notion of Test-Stand [46], and (ii) a Web environment for experimentation called RSPLab, which guarantees reproducibility and repeatability of experimental results using containerization techniques in the context of RDF Stream Processing. Moreover, in [44], we highlight the issues related to designing a query language based on RSP-QL formalization that treats streams as first-class objects and keeps the constructs minimal, homogeneous, symmetric and orthogonal [15].…”
Section: Major Resultsmentioning
confidence: 99%
“…Third, the long term success of stream reasoning requires a framework for comparative evaluation [64,29]. The community needs a comprehensive and widely accepted benchmark that can be used to provide concrete evidence that stream reasoning is the best solution in some domain.…”
Section: Discussion and Future Workmentioning
confidence: 99%
“…Since these works support different semantics, it is challenging to compare them. Indeed, providing a fair and comprehensive comparison of the various proposal remains an open problem, despite notable efforts in this direction [30,33,34].…”
Section: Related Work and Conclusionmentioning
confidence: 99%