Reproducible Software Appliances for Experimentation

Ruiz, Cristian; Richard, Olivier; Emeras, Joseph

doi:10.1007/978-3-319-13326-3_4

Cited by 7 publications

(5 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This paper identifies the necessary ingredients for a software appliance builder to be a viable solution for the preservation and packaging of experimental setups. The contributions of this paper and what makes it different from our two previous publications [8,13] are:…”

Section: Contributionsmentioning

confidence: 93%

“…Data is captured in two ways: 1) Polipo 24 a web proxy cache for caching all the packages coming from the network, and 2) custom procedures for caching data coming from other sources. This mechanism is detailed in [13]. The persistent cache archive is structured by step (Kameleon hierarchy) and it contains files, control version repositories and mainly cache files generated by Polipo.…”

Section: Persistent Cache Mechanismmentioning

confidence: 99%

“…It refers to source code compiled for testing 13. https://www.docker.io/ 14 https://www.kernel.org/doc/Documentation/cgroups/cgroups.txt 15 http://www.packer.io/ 16 http://boxgrinder.org/ 17 http://libguestfs.org/…”

mentioning

confidence: 99%

See 2 more Smart Citations

Reconstructable Software Appliances with Kameleon

Ruiz

Harrache

Mercier

et al. 2015

SIGOPS Oper. Syst. Rev.

Self Cite

View full text Add to dashboard Cite

International audienceA software appliance builder bundles together an application with its needed middleware and an operating system to allow easy deployment on Infrastructure as a Service (IaaS) providers. These builders have the potential to address a key need in our community: the ability to reproduce an experiment. This paper reports the experiences on developing a software appliance builder called Kameleon that leverages popular and well tested tools. Kameleon simplifies the creation of complex software appliances that are targeted at research on operating systems, HPC and distributed computing. It does so by proposing a highly modular description format that encourages collaboration and reuse of procedures. Moreover, it provides debugging mechanisms for improving experimenter's productivity. To justify that our appliance builder stands above others, we compare it with the most known tools used by developers and researchers to automate the construction of software environments for virtual machines and IaaS infrastructures

show abstract

Section: Contributionsmentioning

confidence: 93%

Section: Persistent Cache Mechanismmentioning

confidence: 99%

See 1 more Smart Citation

Reconstructable Software Appliances with Kameleon

Ruiz

Harrache

Mercier

et al. 2015

SIGOPS Oper. Syst. Rev.

Self Cite

View full text Add to dashboard Cite

show abstract

“…Among the few tools specifically designed for this purpose and based on recipes, we can cite Kameleon [9], which allows to reconstruct an environment step by step. Another approach consists in automatically capturing the environment required to run the code (e.g., as done by CDE [14, chap.4].)…”

Section: Related Workmentioning

confidence: 99%

An Effective Git And Org-Mode Based Workflow For Reproducible Research

Stanisic

Legrand

Danjean

2015

SIGOPS Oper. Syst. Rev.

View full text Add to dashboard Cite

In this paper we address the question of developing a lightweight and effective workflow for conducting experimental research on modern parallel computer systems in a reproducible way. Our approach builds on two well-known tools (Git and Org-mode) and enables to address, at least partially, issues such as running experiments, provenance tracking, experimental setup reconstruction or replicable analysis. We have been using such a methodology for two years now and it enabled us to recently publish a fully reproducible article [12]. To fully demonstrate the effectiveness of our proposal, we have opened our two year laboratory notebook with all the attached experimental data. This notebook and the underlying Git revision control system enable to illustrate and to better understand the workflow we used.

show abstract

“…In recent years, a plethora of tools have been developed to address the general problem of computational reproducibility 1 , 2 , a critical subset being the reproduction of pipelines across platforms to share them with other researchers. Prominent tools include workflow engines like Snakemake 3 or Nextflow 4 , which provide their own language to describe pipelines and setup routines.…”

Section: Introductionmentioning

confidence: 99%

Bashing irreproducibility with shournal

Kirchner,

Riege,

Hoffmann

2024

Sci Rep

View full text Add to dashboard Cite

Arguably, the most important tool for many computational scientists is the Linux shell. Processing steps carried out there are critical for a large number of analyses. While the manual documentation of the work is time-consuming and error-prone, existing tools do not integrate well into the shell or suffer from a large overhead. Here, we present shournal, which integrates tightly into the shell and automatically records all shell commands along with their associated file events. Thus, for all files, it can later be told how they were generated and processed. Additionally, it allows the creation of detailed reports for whole project folders. shournal retrieves its data directly from the Linux kernel and allows the monitoring of whole process trees with low overhead.

show abstract

Reproducible Software Appliances for Experimentation

Cited by 7 publications

References 9 publications

Reconstructable Software Appliances with Kameleon

Reconstructable Software Appliances with Kameleon

An Effective Git And Org-Mode Based Workflow For Reproducible Research

Bashing irreproducibility with shournal

Contact Info

Product

Resources

About