Using Information Visualization and Text Mining to Facilitate the Conduction of Systematic Literature Reviews

Fabbri, Sandra; Hernandes, Elis Montoro; Thommazo, André Di; Belgamo, Anderson; Zamboni, Augusto; Silva, Cleiton

doi:10.1007/978-3-642-40654-6_15

Cited by 19 publications

(21 citation statements)

References 5 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…However, the tools have not been properly evaluated and the identified primary studies presented only some case studies or small experiments to exemplify the use of a tool or its effectiveness. Four tools (StArtState of the Art through Systematic Review [5], SLuRp, SLRTool, and SLRTool) support the whole SR process and they are evaluated in [9]. The authors used feature analysis to check the SR activities that each tool supports.…”

Section: Background and Related Workmentioning

confidence: 99%

“…One of themStArt (State of the Art through Systematic Review) [5] presents some features to support the decision-making process associated with the initial selection activity: a score used to classify the primary studies based on their relevance (according to the keywords defined in the protocol), and the citation relationships. These features are the basis of the score citation automatic selection (SCAS) strategy, developed to make the initial selection activity as automated as possible [6].…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Using the SCAS strategy to perform the initial selection of studies in systematic reviews

Octaviano

Silva

Fabbri

2016

Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering

Self Cite

View full text Add to dashboard Cite

Context: Systematic Review (SR) is a well-defined and rigorous methodology used to find relevant evidence about a specific topic of interest. Depending on the number of identified primary studies, the selection activity can be very time-consuming and a strategy, like SCAS, to semi-automate this activity can be helpful. Objective: To present an experimental study carried out to evaluate the SCAS strategy. Method: We conducted an experiment to compare the efficiency and effectiveness between participants using SCAS and the manual approach. They received necessary training for applying SCAS using tool support. They were divided into five groups, which conducted SRs based on their research areas. Results: When applying SCAS, the average effort reduction was 22.33%, and the average percentage error was 3.95% with a minimal loss of 1.6 evidence per SR. In addition, results showed an overall precision of 65.49% on an overall recall of 90.24% when using SCAS. The overall Kappa showed that there is a substantial agreement level between the groups and SCAS. Conclusion: The experiment increased the confidence in the strategy, reinforcing that it can reduce the effort required to select primary studies without adversely affecting the overall results of SRs.

show abstract

Section: Background and Related Workmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Using the SCAS strategy to perform the initial selection of studies in systematic reviews

Octaviano

Silva

Fabbri

2016

Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

“…Prior empirical software engineering (ESE) research had not explained enough how text mining techniques can fit into the planning of an SLR [18][19][20][21][22][23][24][25]. TM techniques enable effective knowledge acquisition and discovery process to support SLRs and reduce the workload in planning SLRs.…”

Section: Theoretical Contributionsmentioning

confidence: 99%

“…The research provides a new way of thinking about how the level of quality of a review can be improved, by reducing the decision-making problems that can arise during SLR planning, especially in the development of review protocols. This is because, the existing studies [18][19][20][21][22][23][24][25] have not considered applying TM tecniques to retrieve information that can support the decision-making activities during SLR planning. Although Fernández-Sáez et al [20] have developed a tool named SLR-Tool to capture the planning information of a project, they did not TM technique to support effective planning.…”

Section: Theoretical Contributionsmentioning

confidence: 99%

Using Suffix Tree Clustering Method To Support The Planning Phase Of Systematic Literature Review

Feng

Chiam

Faiza

et al. 2017

MJCS

View full text Add to dashboard Cite

Systematic Literature Review (SLR) is an information-based process throughout which each stage must be carefully and systematically designed in planning phase. Important decisions need to be made about the various choices involved in the SLR planning phase. However, due to the necessarily comprehensive and rigorous nature of SLR, many researchers have difficulties in planning SLRs sufficiently and effectively. In recent decades, the use of text mining (TM) techniques has been introduced to facilitate SLR process, especially at conducting review phase to support the searching and selection of studies. However, so far, TM techniques have not been applied to support any activities during SLR planning phase. In this research, we proposed a method that apply Suffix Tree Clustering (STC) method to support decision-making activities within the SLR planning phase. This method also known as SLR Planning Based on Suffix Tree Clustering (SLRP-STC) method. It aims to help reviewers in three ways: 1) to extract research topics easily; 2) to better interpret extracted information; and 3) to quickly realize and refine a proposed search string that is poorly formulated or inappropriate. A case study was conducted by comparing the proposed method with manual approach. It is observed that the use of SLRP-STC method can improve the planning of SLR.Keywords: Systematic Literature Review (SLR), planning phase; decision-making, Suffix Tree Clustering (STC), text mining (TM) INTRODUCTIONSystematic Literature Review (SLR), or Systematic Review (SR), provides a fair and reliable approach to identify, evaluate, and synthesize all primary studies, in attempt to address specific research questions [1]. SLR differs from ordinary review process in term of formal planning. Staples and Niazi [2] define a well-planned SLR as "independently replicable and of greater scientific value than ordinary literature reviews". For another, creating a comprehensive review plan is the key to the success of SLR as it drives the entire review methodology. Effective SLR planning takes into consideration all aspects of planning including identification of review need, specification of research questions, development, and validation of the review protocol.Performing SLR comprises three main phases: 1) planning the review, 2) conducting the review, and 3) reporting the review [5]. Particularly, planning phase is important to ensure the overall quality of SLR process. During the planning phase, reviewers are required to have adequate knowledge of the proposed topic area so they are likely to make a strategic plan for the SLR. For example, reviewers should confirm that there are likely to be sufficient relevant studies to make their SLRs worthwhile. They should also obtain the necessary information relevant to the studies, such as the number of independent studies that make review worthwhile, the research topics, the commonly used terms, and keywords. In this case, effective knowledge acquisition and discovery process can be useful and necessary in supporti...

show abstract

“…In addition to the improved features for fixing the issues, StArt has some particularities, like the ranking of primary studies according to their relevance based on a calculated score and the use of visualization resources to support some SR activities [4]. They are mentioned in the next sections.…”

mentioning

confidence: 99%

Improvements in the StArt tool to better support the systematic review process

Fabbri

Silva

Hernandes

et al. 2016

Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering

Self Cite

167

View full text Add to dashboard Cite

Using Information Visualization and Text Mining to Facilitate the Conduction of Systematic Literature Reviews

Cited by 19 publications

References 5 publications

Using the SCAS strategy to perform the initial selection of studies in systematic reviews

Using the SCAS strategy to perform the initial selection of studies in systematic reviews

Using Suffix Tree Clustering Method To Support The Planning Phase Of Systematic Literature Review

Improvements in the StArt tool to better support the systematic review process

Contact Info

Product

Resources

About