Reproducibility verification is essential to the practice of the scientific method. Researchers report their findings, which are strengthened as other independent groups in the scientific community share similar outcomes. In the many scientific fields where software has become a fundamental tool for capturing and analyzing data, this requirement of reproducibility implies that reliable and comprehensive software platforms and tools should be made available to the scientific community. The tools will empower them and the public to verify, through practice, the reproducibility of observations that are reported in the scientific literature. Medical image analysis is one of the fields in which the use of computational resources, both software and hardware, are an essential platform for performing experimental work. In this arena, the introduction of the Insight Toolkit (ITK) in 1999 has transformed the field and facilitates its progress by accelerating the rate at which algorithmic implementations are developed, tested, disseminated and improved. By building on the efficiency and quality of open source methodologies, ITK has provided the medical image community with an effective platform on which to build a daily workflow that incorporates the true scientific practices of reproducibility verification. This article describes the multiple tools, methodologies, and practices that the ITK community has adopted, refined, and followed during the past decade, in order to become one of the research communities with the most modern reproducibility verification infrastructure. For example, 207 contributors have created over 2400 unit tests that provide over 84% code line test coverage. The Insight Journal, an open publication journal associated with the toolkit, has seen over 360,000 publication downloads. The median normalized closeness centrality, a measure of knowledge flow, resulting from the distributed peer code review system was high, 0.46.
Abstract. The ICT revolution of the last decade impacts scientific publishing and changes the format in which articles are delivered and how results of scientific research are communicated. With researchers increasingly generating and referencing 3D data in their articles, the ability to accurately visualize that data in online publications has become extremely important. To address growing demands in online 3D visualization across various scientific domains and journals, Elsevier and Kitware launched a project to develop a 3D visualization infrastructure supporting different data formats, visualization techniques, and interaction styles for online scientific publishing. In this paper, we describe the expandable Hybrid Visualization Platform and five domain-specific 3D visualization viewers and present results of an author feedback survey. The presence of interactive 3D viewers embeddable in online articles is a key example of how the digital article format adds value to scientific communication and how it helps readers to better understand research findings and re-use the associated 3D data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.