Questions for data scientists in software engineering: a replication

Abstract

In 2014, a Microsoft study investigated the sort of questions that data science applied to software engineering should answer. This resulted in 145 questions that developers considered relevant for data scientists to answer, thus providing a research agenda to the community. Fast forward to five years, no further studies investigated whether the questions from the software engineers at Microsoft hold for other software companies, including software-intensive companies with different primary focus (to which we refer as software-defined enterprises). Furthermore, it is not evident that the problems identified five years ago are still applicable, given the technological advances in software engineering.This paper presents a study at ING, a software-defined enterprise in banking in which over 15,000 IT staff provides in-house software solutions. This paper presents a comprehensive guide of questions for data scientists selected from the previous study at Microsoft along with our current work at ING. We replicated the original Microsoft study at ING, looking for questions that impact both software companies and software-defined enterprises and continue to impact software engineering. We also add new questions that emerged from differences in the context of the two companies and the five years gap in between. Our results show that software engineering questions for data scientists in the software-defined enterprise are largely similar to the software company, albeit with exceptions. We hope that the software engineering research community builds on the new list of questions to create a useful body of knowledge. CCS CONCEPTS• General and reference → Surveys and overviews.

Nalanda: a socio-technical graph platform for building software analytics tools at enterprise scale

“…Fritz and Murphy [23] provide a list of questions developers ask for the most frequently sought-after information within a project. Information needs have also been studied in the context of change tasks [41], inter-team coordination [11] and software analytics [13,15,26] Through its applications, Nalanda can efficiently address most information needs related to people, code, and work items. For example, the answer to questions such as "Who is working on what" and "What are coworkers working on right now" is easily available in the MyNalanda application.…”

Facilitating transmuters' acquisition of data scientist knowledge based on their educational backgrounds: state-of-the-practice and challenges

“…However, this study was conducted from a business perspective and includes only 35 analysts' interviews, making it difficult to generalize conclusions. In a study by Huijgens et al (2019), the authors surveyed a Dutch software-defined enterprise that provides banking services (ING) and recorded 171 questions software engineers wanted data scientists to answer. Interestingly, they mainly focused on finding the questions rather than determining their solutions.…”

A Conceptual Model to Support the Transmuters in Acquiring the Desired Knowledge of a Data Scientist

“…In Huijgens et al, the authors surveyed to determine what type of questions the software engineer would like Data scientists to have to answer [18]. conducted a questionnairebased survey to identify the challenges and best practices that data scientists face when performing data science tasks [19].…”