Eye-Tracking Metrics in Software Engineering

Sharafi, Zohreh; Shaffer, Tim; Sharif, Bonita; Guéhéneuc, Yann‐Gaël

doi:10.1109/apsec.2015.53

Cited by 105 publications

(65 citation statements)

References 39 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…We only expect the technology to improve to accommodate more samples as it has been in recent years. Finally, we initiated a call for standardization of visual effort metrics [21] as many researchers use different terms to mean similar things and in some cases different things. This presents problems when comparing studies across different research groups.…”

Section: Resultsmentioning

confidence: 99%

Studying developer gaze to empower software engineering research and practice

Sharif

Clark

Maletic

2016

Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering

Self Cite

View full text Add to dashboard Cite

A new research paradigm is proposed that leverages developer eye gaze to improve the state of the art in software engineering research and practice. The vision of this new paradigm for use on software engineering tasks such as code summarization, code recommendations, prediction, and continuous traceability is described. Based on this new paradigm, it is foreseen that new benchmarks will emerge based on developer gaze. The research borrows from cognitive psychology, artificial intelligence, information retrieval, and data mining. It is hypothesized that new algorithms will be discovered that work with eye gaze data to help improve current IDEs, thus improving developer productivity. Conducting empirical studies using an eye tracker will lead to inventing, evaluating, and applying innovative methods and tools that use eye gaze to support the developer. The implications and challenges of this paradigm for future software engineering research is discussed.

show abstract

Section: Resultsmentioning

confidence: 99%

Studying developer gaze to empower software engineering research and practice

Sharif

Clark

Maletic

2016

Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering

Self Cite

View full text Add to dashboard Cite

show abstract

“…Eye Tracking Studies: Eye-tracking technology is being used in software engineering [20][21][22][23][24][25] to study how programmers read [4,[26][27][28][29][30], review [31][32][33], and summarize [17,28,34] source code. Crosby et al [4] conducted an early eye-tracking study of high and low experience programmers reading a binary search algorithm.…”

Section: Related Workmentioning

confidence: 99%

Developer Reading Behavior While Summarizing Java Methods: Size and Context Matters

Abid

Sharif

Dragan

et al. 2019

2019 IEEE/ACM 41st International Conference on Software Engineering (ICSE)

Self Cite

View full text Add to dashboard Cite

An eye-tracking study of 18 developers reading and summarizing Java methods is presented. The developers provide a written summary for methods assigned to them. In total, 63 methods are used from five different systems. Previous studies on this topic use only short methods presented in isolation usually as images. In contrast, this work presents the study in the Eclipse IDE allowing access to all the source code in the system. The developer can navigate via scrolling and switching files while writing the summary. New eye-tracking infrastructure allows for this improvement in the study environment. Data collected includes eye gazes on source code, written summaries, and time to complete each summary. Unlike prior work that concluded developers focus on the signature the most, these results indicate that they tend to focus on the method body more than the signature. Moreover, both experts and novices tend to revisit control flow terms rather than reading them for a long period. They also spend a significant amount of gaze time and have higher gaze visits when they read call terms. Experts tend to revisit the body of the method significantly more frequently than its signature as the size of the method increases. Moreover, experts tend to write their summaries from source code lines that they read the most.

show abstract

“…In our study we used the IV-T algorithm provided by the Tobii Pro lab software. The way we can extract metrics and information from scanpath has also been widely documented [8,5,16,13].…”

Section: Linking Cognitive Processes and Eye Movementsmentioning

confidence: 99%

Eye Gaze Sequence Analysis to Model Memory in E-education

Beuget

Castagnos

Luxembourger

et al. 2019

Lecture Notes in Computer Science

View full text Add to dashboard Cite

Intelligent Tutoring Systems are now mature technologies that successfully help students to acquire new knowledge and competencies through various educational methods and in a personalized way. However, evaluating precisely what they recall at the end of the learning process remains a complex task. In this paper, we study if there are correlations between memory and gaze data in the context of e-education. Our long-term goal is to model the memory of students thank to an eyetracker in a continuous and transparent way. These models could then be used to adapt recommendations of pedagogical resources to the students learning rate. So as to address this research question, we designed an experiment where students were asked to learn a short lesson about Esperanto. Our results show that some gaze characteristics are correlated with recall in memory.

show abstract

Eye-Tracking Metrics in Software Engineering

Cited by 105 publications

References 39 publications

Studying developer gaze to empower software engineering research and practice

Studying developer gaze to empower software engineering research and practice

Developer Reading Behavior While Summarizing Java Methods: Size and Context Matters

Eye Gaze Sequence Analysis to Model Memory in E-education

Contact Info

Product

Resources

About