Bayesian Synthesis for Knowledge Translation in Software Engineering: Method and Illustration

Abstract

Systematic literature reviews in software engineering are necessary to synthesize evidence from multiple studies to provide knowledge and decision support. However, synthesis methods are underutilized in software engineering research. Moreover, translation of synthesized data (outcomes of a systematic review) to provide recommendations for practitioners is seldom practiced. The objective of this paper is to introduce the use of Bayesian synthesis in software engineering research, in particular to translate research evidence into practice by providing the possibility to combine contextualized expert opinions with research evidence. We adopted the Bayesian synthesis method from health research and customized it to be used in software engineering research. The proposed method is described and illustrated using an example from the literature. Bayesian synthesis provides a systematic approach to incorporate subjective opinions in the synthesis process thereby making the synthesis results more suitable to the context in which they will be applied. Thereby, facilitating the interpretation and translation of knowledge to action/application. None of the synthesis methods used in software engineering allows for the integration of subjective opinions, hence using Bayesian synthesis can add a new dimension to the synthesis process in software engineering research.

Evidence and perceptions on GUI test automation - An Exploratory Study

“…In the first phase of the interview, we asked for unbiased opinions of the practitioners regarding testability. This phase refers to collecting prior opinions in Bayesian synthesis [5]. The practitioners mentioned some of the factors that were reported in the literature.…”

“…EBSE recommends validating the research-based evidence obtained from literature by integrating the evidence with practitioners' opinions and experiences. This phase refers to collecting revised opinions in Bayesian synthesis [5]. In this phase, all findings are discussed.…”

“…We conducted a two-phased interview to collect the practitioners' subjective opinions and gather their opinions on the evidence collected from the literature. We adopted the Bayesian synthesis method [5] which consists of collecting practitioners' prior opinions and then collecting revised opinions in the light of evidence from the literature.…”

Towards evidence‐based decision‐making for identification and usage of assets in composite software: A research roadmap

“…20,46 Hence, the concrete activities resulting in the roadmap is the closure of the project and documentation of the further research needed in the area. In particular, the systematic literature review, 50 the case survey, 20 and the survey 28 provided essential input to formulate the roadmap. For the specific activities concerning the development of the roadmap, we followed a systematic process.…”

“…100 • A synthesis method that takes into account both the practitioners' experience and evidence to contextualize the knowledge is presented in Badampudi and Wohlin. 50 The synthesis method by Badampudi and Wohlin 50 is based on Bayesian principles which start by collecting the prior opinion that is based on the experience of the practitioners which is then revised in the light of the evidence provided to the practitioners.…”