Selecting the Right Topics for Industry-Academia Collaborations in Software Testing: An Experience Report

Garousi, Vahid; Herkiloğlu, Kadir

doi:10.1109/icst.2016.7

Cited by 16 publications

(21 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Can "conceptually" address Can "concretely" address Can be implemented by relevant SE research problems, a few approaches (mechanisms) have been published, e.g., (Garousi et al 2017a;Garousi and Herkiloğlu 2016).…”

Section: Root Causes Of the Relevance Problemmentioning

confidence: 99%

“…12. It should be recalled once again that the focus of this paper is on the first two issues (root causes and improvement suggestions), since widening the scope to improvement mechanisms would lead to an impractical broadening of the study and to the inclusion of further papers (e.g., (Garousi et al 2017a;Garousi and Herkiloğlu 2016)) and GL sources. This extension can be done in a follow-up study.…”

Section: Focus Of This Papermentioning

confidence: 99%

“…To "concretely" do that, the approaches (mechanisms) proposed in (Garousi et al 2017a; Garousi and Herkiloğlu 2016) could be used. For example, a recent study (Garousi and Herkiloğlu 2016) explored what industry wants from academia in software testing by gathering practitioners' opinions.…”

Section: Focus Of This Papermentioning

confidence: 99%

“…S18, an IEEE Computer paper entitled "Making SE research relevant", suggested to researchers to: "Ensure research is relevant, reflects the needs of practice, and can confidently declare the reason for conducting it". Selecting the "right" topics for IAC is sometimes easier said than done, but there are guidelines for it, e.g., (Garousi and Herkiloğlu 2016). S9 suggested to researchers to "understand the problems and priorities of the many industry sectors that develop software".…”

Section: Choosing Relevant Research Problemsmentioning

confidence: 99%

“…For example, (Garousi et al 2017a) explored what industry wants from academia in software testing by gathering practitioners' opinions. An experience report for selecting the "right" topics (ensuring both rigor and relevance) in IAC in software testing was reported in (Garousi and Herkiloğlu 2016). Misirli et al (Misirli et al 2014) proposed four fitness criteria as guidelines for topic selection in industry experiments: (1) concreteness of the topic, (2) suitability of the topic for experimentation, (3) relevance of the topic to research community, and (4) prior domain experience (of researchers).…”

Section: Choosing Relevant Research Problemsmentioning

confidence: 99%

See 4 more Smart Citations

Practical relevance of software engineering research: synthesizing the community’s voice

2020

Self Cite

View full text Add to dashboard Cite

Software engineering (SE) research should be relevant to industrial practice. There have been regular discussions in the SE community on this issue since the 1980's, led by pioneers such as Robert Glass. As we recently passed the milestone of "50 years of software engineering", some recent positive efforts have been made in this direction, e.g., establishing "industrial" tracks in several SE conferences. However, many researchers and practitioners believe that we, as a community, are still struggling with research relevance and utility. The goal of this paper is to synthesize the evidence and experience-based opinions shared on this topic so far in the SE community, and to encourage the community to further reflect and act on the research relevance. For this purpose, we have conducted a Multi-vocal Literature Review (MLR) of 54 systematically-selected sources (papers and non peer-reviewed articles). Instead of relying on and considering the individual opinions on research relevance, mentioned in each of the sources, the MLR aims to synthesize and provide the "holistic" view on the topic. The highlights of our MLR findings are as follows. The top three root causes of low relevance, discussed in the community, are: (1) Researchers having simplistic views (or wrong assumptions) about SE in practice; (2) Lack of connection with industry; and (3) Wrong identification of research problems. The top three suggestions for improving research relevance are: (1) Using appropriate research approaches such as action-research; (2) Choosing relevant (practical) research problems; and (3) Collaborating with industry. By synthesizing all the discussions on this important topic so far, this paper aims to encourage further discussions and actions in the community to increase our collective efforts to improve the research relevance. Furthermore, we raise the need for empirically-grounded and rigorous studies on the relevance problem in SE research, as carried out in other fields such as management science.

show abstract

Section: Root Causes Of the Relevance Problemmentioning

confidence: 99%

Section: Focus Of This Papermentioning

confidence: 99%

Section: Focus Of This Papermentioning

confidence: 99%

Section: Choosing Relevant Research Problemsmentioning

confidence: 99%

Section: Choosing Relevant Research Problemsmentioning

confidence: 99%

See 3 more Smart Citations

Practical relevance of software engineering research: synthesizing the community’s voice

2020

Self Cite

View full text Add to dashboard Cite

show abstract

Exploring the industry's challenges in software testing: An empirical study

Garousi

Felderer

Kuhrmann

et al. 2020

J Software Evolu Process

View full text Add to dashboard Cite

ContextSoftware testing is an important and costly software engineering activity in the industry. Despite the efforts of the software testing research community in the last several decades, various studies show that still many practitioners in the industry report challenges in their software testing tasks.ObjectiveTo shed light on industry's challenges in software testing, we characterize and synthesize the challenges reported by practitioners. Such concrete challenges can then be used for a variety of purposes, eg, research collaborations between industry and academia.MethodOur empirical research method is opinion survey. By designing an online survey, we solicited practitioners' opinions about their challenges in different testing activities. Our dataset includes data from 72 practitioners from eight different countries.ResultsOur results show that test management and test automation are considered the most challenging among all testing activities by practitioners. Our results also include a set of 104 concrete challenges in software testing that may need further investigations by the research community.ConclusionWe conclude that the focal points of industrial work and academic research in software testing differ. Furthermore, the paper at hand provides valuable insights concerning practitioners' “pain” points and, thus, provides researchers with a source of important research topics of high practical relevance.

show abstract

Together We Are Stronger: Evidence-Based Reflections on Industry-Academia Collaboration in Software Testing

Felderer

Garousi

2019

Software Quality: Quality Intelligence in Software and Systems Engineering

Self Cite

View full text Add to dashboard Cite

For a highly relevant and applied research area like software testing industry-academia collaboration is of uttermost importance. In this paper we reflect on how industry-academia collaboration can be improved based on evidence from four empirical studies. We therefore first present four studies providing evidence on the (1) perceived level of challenges in testing activities, (2) focus areas in industrial and academic software testing conferences, (3) synergies between industrial and academic software testing conferences, as well as (4) the need for consideration of grey literature. Then, we reflect on issues, which we think can improve the link and synergies between industry and academia in software testing, i.e., research topics, guidelines and evidence, value and risk, context and scalability, action research and education as well as grey literature and open science.

show abstract

Selecting the Right Topics for Industry-Academia Collaborations in Software Testing: An Experience Report

Cited by 16 publications

References 22 publications

Practical relevance of software engineering research: synthesizing the community’s voice

Practical relevance of software engineering research: synthesizing the community’s voice

Exploring the industry's challenges in software testing: An empirical study

Together We Are Stronger: Evidence-Based Reflections on Industry-Academia Collaboration in Software Testing

Contact Info

Product

Resources

About