Quality Assessment in Systematic Literature Reviews: A Software Engineering Perspective

Yang, Lanxin; Zhang, He; Shen, Haifeng; Huang, Xin; Zhou, Xin; Rong, Guoping; Dong, Shuai

doi:10.1016/j.infsof.2020.106397

Cited by 64 publications

(37 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…It should be noted that the quality of an SLR is highly influenced by the quality of the primary studies included. The need to assess the quality of primary studies is highlighted by, for example, Dybå and Dingsøyr [15], and Yang et al [28]. With the same objective, Wohlin highlights the need to write for synthesis when publishing primary studies [29].…”

Section: Discussionmentioning

confidence: 99%

A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering

Usman¹,

Ali²,

Wohlin³

2021

Preprint

View full text Add to dashboard Cite

Context: Systematic literature reviews (SLRs) have become standard practise as part of software engineering research, although their quality varies. To build on the reviews, both for future research and industry practice, they need to be of high quality.Objective: To assess the quality of SLRs in software engineering, we put forward an appraisal instrument for SLRs. The instrument is intended for use by appraisers of reviews, but authors may also use it as a checklist when designing and documenting their reviews. Method: A well-established appraisal instrument from research in healthcare was used as a starting point to develop a quality assessment instrument. It is adapted to software engineering using guidelines, checklists, and experiences from software engineering. As a validation step, the first version was reviewed by four external experts on SLRs in software engineering and updated based on their feedback. Results: The outcome of the research is an appraisal instrument for quality assessment of SLRs in software engineering. The instrument intends to support the appraiser in assessing the quality of an SLR. The instrument includes 16 items with different options to capture the quality. The item is assessed on a two or three-grade scale, depending on the item. The instrument also supports consolidating the items into groups, which are then used to assess the overall quality of a systematic literature review. Conclusion: It is concluded that the presented instrument may be helpful support for an appraiser in assessing the quality of SLRs in software engineering.

show abstract

Section: Discussionmentioning

confidence: 99%

A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering

Usman¹,

Ali²,

Wohlin³

2021

Preprint

View full text Add to dashboard Cite

show abstract

“…In addition to general inclusion and exclusion criteria, the included studies were assessed against a set of six quality questions listed in Table 1, which were adopted and adjusted from other studies [61,62]. Each question was answered according to a binary scale (i.e., 1 for Yes or 0 for No).…”

Section: Methodological Quality Assessmentmentioning

confidence: 99%

Systematic literature review of context-awareness applications supported by smart cities’ infrastructures

et al. 2022

View full text Add to dashboard Cite

Since none of the existing systematic reviews of the literature related to smart cities have focused on smart cities applications using context-aware features, this study aims to provide a comprehensive view of (1) the characteristics of context-aware applications supported by smart cities’ infrastructures, (2) the characteristics of the context-aware technologies being used, and (3) the maturity level of the identified applications. An electronic search was conducted on Scopus, Web of Science, and IEEE Xplore databases, combining relevant keywords. After the studies’ selection, 27 studies were included. The results show the interest in using context-aware features to develop smart cities’ applications targeting public health, tourism experience, urban mobility, active citizenship, shopping experience, management of urban infrastructures, public alerts, recommenders, and smart environments. Moreover, the applications reported by the included studies do not allow the execution of actions without the explicit consent of the users, and they integrate personal sensors, sensors deployed in the city and crowdsourcing mechanisms to acquire primary context attributes (i.e., location, activity, and environment) and secondary context attributes (i.e., speed, physical activity, points of interest, stress, and tourists’ emotions). In addition, the included studies present scarce details about context reasoning, data privacy, integrity, and confidentiality, data aggregation and accuracy, and data interoperability. Finally, the results also indicate low maturity level of the developed applications, which is evidenced by the lack of user-centred evaluations, as well as by the difficulty in integrating important technologies being developed for smart cities.

show abstract

“…Quality assessment of the reviewed literature is supremely important to a systematic literature review as the quality of conclusions entirely depends on the quality of selected literature (Yang, et al, 2021). Therefore, 110 full-text articles shortlisted from the initial search were thoroughly skimmed to evaluate the quality and eligibility of the articles.…”

Section: Methodsmentioning

confidence: 99%

HR factors for the successful implementation of Industry 4.0: A systematic literature review

Verma¹,

Venkatesan

2021

Journal of General Management

View full text Add to dashboard Cite

As the world moves deeper into the fourth industrial revolution, organizations around the world are polarizing towards the transformation and adoption of the advanced technologies of Industry 4.0. However, recent studies suggest that organizations struggle and face several managerial challenges in their implementation. As a consequence, many studies examined the potential factors that can influence Industry 4.0 implementation. Based on a systematic literature review, this study has tried to explore, examine, and synthesize the potential human resource (HR) success factors and develop an efficient Industry 4.0 HR framework that can play a vital role in Industry 4.0 implementation. This study would also build a solid foundation for practitioners, academicians, and researchers to get a better understanding of the impact of Industry 4.0 on HR management.

show abstract

Quality Assessment in Systematic Literature Reviews: A Software Engineering Perspective

Cited by 64 publications

References 28 publications

A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering

A Quality Assessment Instrument for Systematic Literature Reviews in Software Engineering

Systematic literature review of context-awareness applications supported by smart cities’ infrastructures

HR factors for the successful implementation of Industry 4.0: A systematic literature review

Contact Info

Product

Resources

About