2019
DOI: 10.3390/a12070127
|View full text |Cite
|
Sign up to set email alerts
|

Guidelines for Experimental Algorithmics: A Case Study in Network Analysis

Abstract: The field of network science is a highly interdisciplinary area; for the empirical analysis of network data, it draws algorithmic methodologies from several research fields. Hence, research procedures and descriptions of the technical results often differ, sometimes widely. In this paper we focus on methodologies for the experimental part of algorithm engineering for network analysis -an important ingredient for a research area with empirical focus. More precisely, we unify and adapt existing recommendations f… Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
1
1
1

Citation Types

0
19
0

Year Published

2019
2019
2023
2023

Publication Types

Select...
3
3
2

Relationship

3
5

Authors

Journals

citations
Cited by 18 publications
(19 citation statements)
references
References 96 publications
0
19
0
Order By: Relevance
“…For each graph we repeat the experiment three times and we set the imbalance tolerance to 3%, one of the values used in [36] and in ParMETIS. To ensure reproducibility, all experiments were managed by SimexPal [2]. Our code and the experimental pipeline can be found at https://github.com/hu-macsy/KaHIP.…”
Section: Methodsmentioning
confidence: 99%
“…For each graph we repeat the experiment three times and we set the imbalance tolerance to 3%, one of the values used in [36] and in ParMETIS. To ensure reproducibility, all experiments were managed by SimexPal [2]. Our code and the experimental pipeline can be found at https://github.com/hu-macsy/KaHIP.…”
Section: Methodsmentioning
confidence: 99%
“…Our algorithms are implemented in the NetworKit [20] C++ framework and use PCG32 [21] to generate random numbers. All experiments were managed by the SimexPal software to ensure reproducibility [22]. Experiments were executed with sequential code on a Linux machine with an Intel Xeon Gold 6154 CPU and 1.5 TiB of memory.…”
Section: Methodsmentioning
confidence: 99%
“…Graph processing suffers from methodological issues similar to other computing disciplines. 5,24 Running comprehensive graph processing experiments, especially at scale, lacks tractability 9 -that is, the ability to implement, deploy, and experiment within a reasonable amount of time and cost. As in other computing disciplines, 5,24 we need new, reproducible, experimental methodologies.…”
Section: Ecosystemsmentioning
confidence: 99%
“…We envision a combination of approaches. As in other computing disciplines, 5,24 we need new, reproducible experimental methodologies. Concrete questions arise: How do we facilitate quick yet meaningful performance testing?…”
Section: Resource Managersmentioning
confidence: 99%