Scientific workflows for computational reproducibility in the life sciences: Status, challenges and opportunities

Abstract

With the development of new experimental technologies, biologists are faced with an avalanche of data to be computationally analyzed for scientific advancements and discoveries to emerge. Faced with the complexity of analysis pipelines, the large number of computational tools, and the enormous amount of data to manage, there is compelling evidence that many if not most scientific discoveries will not stand the test of time: increasing the reproducibility of computed results is of paramount importance. The objective we set out in this paper is to place scientific workflows in the context of reproducibility. To do so, we define several kinds of reproducibility that can be reached when scientific workflows are used to perform experiments. We characterize and define the criteria that need to be catered for by reproducibility-friendly scientific workflow systems, and use such criteria to place several representative and widely used workflow systems and companion tools within such a framework. We also discuss the remaining challenges posed by reproducible scientific workflows in the life sciences. Our study was guided by three use cases from the life science domain involving in silico experiments. (Résumé d'auteur

The CoLoMoTo Interactive Notebook: Accessible and Reproducible Computational Analyses for Qualitative Biological Networks

“…The literature provides a range of definitions for the reproducibility of in silico experiments by analogy to wet lab experiments [12,14,17,18,21,29,44]. Four levels of reproducibility are then commonly…”

Towards transparent and consistent exchange of knowledge for improved microbiological food safety

“…With the development of new experimental technologies, food microbiologists and risk assessors are now confronted with large datasets that are computationally analyzed for extracting the biological information of interest. Facing the statistical complexity of data analysis and the heterogeneity of available software tools, CohenBoulakia et al [39 ] argue that some scientific results will not stand the test of time. Indeed, no one will be able to reproduce results that are dependent of programmes that may not be maintained in the future.…”

Enabling Precision Medicine via standard communication of HTS provenance, analysis, and results

“…Developments in workflow management systems have led to the proposition of using workflowcentric research objects with executable components [13,34]. The use of workflow creation and management software allows researchers to utilize different resources to create complex analysis pipelines that can be executed locally, on institutional servers, and on the cloud [15,53]. Extensive reviews of current workflow systems for bioinformatics are linked [16,[53][54][55].…”

“…The use of workflow creation and management software allows researchers to utilize different resources to create complex analysis pipelines that can be executed locally, on institutional servers, and on the cloud [15,53]. Extensive reviews of current workflow systems for bioinformatics are linked [16,[53][54][55]. Ongoing systems participate in the current trend of moving from graphical system back to script-like workflows.…”