A survey on the usage of eye-tracking in computer programming

Obaidellah, Unaizah, Al Haek, Mohammed and Cheng, Peter (2018) A survey on the usage of eye-tracking in computer programming. ACM Computing Surveys, 51 (1). ISSN 0360-0300

[img] PDF (© ACM, 2018. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM Computing Surveys, {VOL51 ISS1 (2018)} https://doi.org/10.1145/3145904) - Accepted Version
Download (4MB)
[img] PDF - Published Version
Restricted to SRO admin only

Download (2MB)

Abstract

Traditional quantitative research methods of data collection in programming, such as questionnaires and in- terviews, are the most common approaches for researchers in this eld. However, in recent years, eye-tracking has been on the rise as a new method of collecting evidence of visual attention and the cognitive process of programmers. Eye-tracking has been used by researchers in the eld of programming to analyze and under- stand a variety of tasks such as comprehension and debugging. In this article, we will focus on reporting how experiments that used eye-trackers in programming research are conducted, and the information that can be collected from these experiments. In this mapping study, we identify and report on 63 studies, published be- tween 1990 and June 2017, collected and gathered via manual search on digital libraries and databases related to computer science and computer engineering. Among the ve main areas of research interest are program comprehension and debugging, which received an increased interest in recent years, non-code comprehen- sion, collaborative programming, and requirements traceability research, which had the fewest number of publications due to possible limitations of the eye-tracking technology in this type of experiments. We nd that most of the participants in these studies were students and faculty members from institutions of higher learning, and while they performed programming tasks on a range of programming languages and program- ming representations, we nd Java language and Uni ed Modeling Language (UML) representation to be the most used materials. We also report on a range of eye-trackers and attention tracking tools that have been utilized, and nd Tobii eye-trackers to be the most used devices by researchers.

Item Type: Article
Keywords: Eye tracker, programming, empirical studies, HCI, debugging, compre- hension, participants, test materials, eye-tracking metrics
Schools and Departments: School of Engineering and Informatics > Informatics
Subjects: Q Science > QA Mathematics > QA0075 Electronic computers. Computer science
Related URLs:
Depositing User: Peter Cheng
Date Deposited: 27 Apr 2018 08:11
Last Modified: 27 Apr 2018 08:11
URI: http://srodev.sussex.ac.uk/id/eprint/67114

View download statistics for this item

📧 Request an update