Topic modeling in software engineering research

Abstract

Topic modeling using models such as Latent Dirichlet Allocation (LDA) is a text mining technique to extract human-readable semantic “topics” (i.e., word clusters) from a corpus of textual documents. In software engineering, topic modeling has been used to analyze textual data in empirical studies (e.g., to find out what developers talk about online), but also to build new techniques to support software engineering tasks (e.g., to support source code comprehension). Topic modeling needs to be applied carefully (e.g., depending on the type of textual data analyzed and modeling parameters). Our study aims at describing how topic modeling has been applied in software engineering research with a focus on four aspects: (1) which topic models and modeling techniques have been applied, (2) which textual inputs have been used for topic modeling, (3) how textual data was “prepared” (i.e., pre-processed) for topic modeling, and (4) how generated topics (i.e., word clusters) were named to give them a human-understandable meaning. We analyzed topic modeling as applied in 111 papers from ten highly-ranked software engineering venues (five journals and five conferences) published between 2009 and 2020. We found that (1) LDA and LDA-based techniques are the most frequent topic modeling techniques, (2) developer communication and bug reports have been modelled most, (3) data pre-processing and modeling parameters vary quite a bit and are often vaguely reported, and (4) manual topic naming (such as deducting names based on frequent words in a topic) is common.

Design A Battery Charger with Arduino Uno-Based for A Wind Energy Power Plant

“…First, determine the gain over all (K) value use Equation 2 [19]. Then, determine of the time constant (τ) value by Equation 3 [20], [21] and Equation 4.…”

A text mining and topic modeling based bibliometric exploration of information science research

“…Suominen et al [12] uses LDA to create topic-based linkages between publications and patents based on the semantic content in the documents. In empirical investigations [13], topic modeling has analyzed textual data. Between 2009 and 2020, the study analyzed subject modeling in 111 publications from the top ten ranked software engineering journals.…”

Identification and Refactoring of Design Problems in Software Systems

“…To meet such requirements, OrganicRef allows the use of multiple context-selection strategies. It also relies on Topic Modeling (Silva, Galster and Gilson 2021) for iden-tifying the features implemented by code elements. Then, OrganicRef combines feature-driven and rule-based heuristics to generate refactoring recommendations for a delimited context.…”

“…The DPs are detected through information extracted from the project's design and source code. From the project's design, OrganicRef uses a topic modeling (Silva, Galster and Gilson 2021) algorithm to extract the distribution of features across the project's elements. Then, it relies on the source code to collect quality measures and code smells.…”

“…Among the available algorithms, we decided to use their Latent Dirichlet Allocation (LDA) parallel topic modeling implementation. LDA was selected because it was previously applied in multiple software engineering studies as demonstrated by a recent literature review (Silva, Galster and Gilson 2021).…”