The Assessor's Dilemma: Improving Bug Repair via Empirical Game Theory

Gavidia-Calderon, Carlos; Sarro, Federica; Harman, Mark; Barr, Earl T.

doi:10.1109/tse.2019.2944608

Cited by 10 publications

(3 citation statements)

References 45 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Here, we applied it to the technical debt problem. In other work, we built a tool, which we christened TaskAssessor, that applies GTPI to diagnose and remove priority inflation [53].…”

Section: Output Descriptionmentioning

confidence: 99%

Game-theoretic analysis of development practices: Challenges and opportunities

Gavidia-Calderon

Sarro

Harman

et al. 2020

Journal of Systems and Software

Self Cite

View full text Add to dashboard Cite

Developers continuously invent new practices, usually grounded in hard-won experience, not theory. Game theory studies cooperation and conflict; its use will speed the development of effective processes. A survey of game theory in software engineering finds highly idealised models that are rarely based on process data. This is because software processes are hard to analyse using traditional game theory since they generate huge game models. We are the first to show how to use game abstractions, developed in artificial intelligence, to produce tractable game-theoretic models of software practices. We present Game-Theoretic Process Improvement (GTPI), built on top of empirical game-theoretic analysis. Some teams fall into the habit of preferring "quick-anddirty" code to slow-to-write, careful code, incurring technical debt. We showcase GTPI's ability to diagnose and improve such a development process. Using GTPI, we discover a lightweight intervention that incentivises developers to write careful code: add a single code reviewer who needs to catch only 25% of kludges. This 25% accuracy is key; it means that a reviewer does not need to examine each commit in depth, making this process intervention cost-effective.

show abstract

“…Here, we applied it to the technical debt problem. In other work, we built a tool, which we christened TaskAssessor, that applies GTPI to diagnose and remove priority inflation [53].…”

Section: Output Descriptionmentioning

confidence: 99%

Game-theoretic analysis of development practices: Challenges and opportunities

Gavidia-Calderon

Sarro

Harman

et al. 2020

Journal of Systems and Software

Self Cite

View full text Add to dashboard Cite

show abstract

“…Game theory studies scenarios -called games -where rational and self-interested agents interact, and these interactions affect the utility they perceive. This definition suits board games, card games, markets, and even software development teams [6]. In games like chess, agent preferences are unambiguous: they both have full visibility of the board and want to win the game.…”

Section: Introductionmentioning

confidence: 99%

What Do You Want From Me? Adapting Systems to the Uncertainty of Human Preferences

Gavidia-Calderon

Bennaceur

Kordoni

et al. 2022

2022 IEEE/ACM 44th International Conference on Software Engineering: New Ideas and Emerging Results (ICSE-NIER)

Self Cite

View full text Add to dashboard Cite

Autonomous systems, like drones and self-driving cars, are becoming part of our daily lives. Multiple people interact with them, each with their own expectations regarding system behaviour. To adapt system behaviour to human preferences, we propose and explore a game-theoretic approach. In our architecture, autonomous systems use sensor data to build game-theoretic models of their interaction with humans. In these models, we represent human preferences with types and a probability distribution over them. Game-theoretic analysis then outputs a strategy, that determines how the system should act to maximise utility, given its beliefs over human types. We showcase our approach in a search-and-rescue (SAR) scenario, with a robot in charge of locating victims. According to social psychology, depending on their identity some people are keen to help others, while some prioritise their personal safety. These social identities define what a person favours, so we can map them directly to game-theoretic types. We show that our approach enables a SAR robot to take advantage of human collaboration, outperforming non-adaptive configurations in average number of successful evacuations. CCS CONCEPTS• Computer systems organization → Robotics; • Human-centered computing → Collaborative interaction.

show abstract

“…Issue tracking tools, such as Jira [1], provide a trove of historical information regarding project evolution that promise great value for Empirical Software Engineering research. Such data has been employed to address many software engineering problems such as effort estimation [9,28], task prioritization [13,15,31], task assignment [20], task description enhancement [7], iteration planing [8] and exploring social and human aspects [21,22,32,33]. However, the data made available by previous empirical studies is usually mainly relevant solely to the study's objective.…”

Section: Introductionmentioning

confidence: 99%

A Versatile Dataset of Agile Open Source Software Projects

Tawosi¹,

Al-Subaihin²,

Moussa³

et al. 2022

Preprint

Self Cite

View full text Add to dashboard Cite

Agile software development is nowadays a widely adopted practise in both open-source and industrial software projects. Agile teams typically heavily rely on issue management tools to document new issues and keep track of outstanding ones, in addition to storing their technical details, effort estimates, assignment to developers, and more. Previous work utilised the historical information stored in issue management systems for various purposes; however, when researchers make their empirical data public, it is usually relevant solely to the study's objective. In this paper, we present a more holistic and versatile dataset containing a wealth of information on more than 500,000 issues from 44 open-source Agile software, making it well-suited to several research avenues, and cross-analyses therein, including effort estimation, issue prioritization, issue assignment and many more. We make this data publicly available on GitHub to facilitate ease of use, maintenance, and extensibility.

show abstract

The Assessor's Dilemma: Improving Bug Repair via Empirical Game Theory

Cited by 10 publications

References 45 publications

Game-theoretic analysis of development practices: Challenges and opportunities

Game-theoretic analysis of development practices: Challenges and opportunities

What Do You Want From Me? Adapting Systems to the Uncertainty of Human Preferences

A Versatile Dataset of Agile Open Source Software Projects

Contact Info

Product

Resources

About