Reading plays a vital role in updating the researchers on recent developments in the field, including but not limited to solutions to various problems and collaborative studies between disciplines. Prior studies identify reading patterns to vary depending on the level of expertise of the researcher on the content of the document. We present a pilot study of eye-tracking measures during a reading task with participants across different areas of expertise with the intention of characterizing the reading patterns using both eye movement and pupillary information.
more »
« less
Analyzing Unconstrained Reading Patterns of Digital Documents Using Eye Tracking
Researchers read scientific literature to keep current in the field and find state-of-the-art solutions to various scientific problems. Prior work suggests that reading patterns may vary with the researcher’s domain expertise and on the content of the digital document. In this work, we present a pilot study of eye-tracking measures during a reading task with the options for zooming and panning of the reading material. The main goal is to analyze unconstrained reading patterns of digital documents using eye movement fixations and dwell time on various sections of a digital document. Our results indicate that participants mostly focused on methodology and results sections, which is consistent with the prior work with constrained reading patterns.
more »
« less
- Award ID(s):
- 2045523
- PAR ID:
- 10313300
- Date Published:
- Journal Name:
- 2021 ACM/IEEE Joint Conference on Digital Libraries (JCDL)
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Research Experiences for Undergraduate (REU) programs often introduce students to scientific research and STEM career possibilities. However, the program impact on students and their research skill development is not well understood. In a case study with 10 REU students, the authors used eye-tracking and self-report data to determine student strategies for reading scientific papers and interpreting graphs at the beginning and end of the program. The strategies of REU students and science experts were then compared. The REU students changed their strategies and performed more like experts at posttest. These findings indicate that, during the REU, students acquired expert-like strategies necessary to engage with scientific articles and extract key information from graphs. The study demonstrates that eye-tracking can document skill growth in REU students.more » « less
-
null (Ed.)Program comprehension is a vital skill in software development. This work investigates program comprehension by examining the eye movement of novice programmers as they gain programming experience over the duration of a Java course. Their eye movement behavior is compared to the eye movement of expert programmers. Eye movement studies of natural text show that word frequency and length influence eye movement duration and act as indicators of reading skill. The study uses an existing longitudinal eye tracking dataset with 20 novice and experienced readers of source code. The work investigates the acquisition of the effects of token frequency and token length in source code reading as an indication of program reading skill. The results show evidence of the frequency and length effects in reading source code and the acquisition of these effects by novices. These results are then leveraged in a machine learning model demonstrating how eye movement can be used to estimate programming proficiency and classify novices from experts with 72% accuracy.more » « less
-
An eye-tracking study of 18 developers reading and summarizing Java methods is presented. The developers provide a written summary for methods assigned to them. In total, 63 methods are used from five different systems. Previous studies on this topic use only short methods presented in isolation usually as images. In contrast, this work presents the study in the Eclipse IDE allowing access to all the source code in the system. The developer can navigate via scrolling and switching files while writing the summary. New eye-tracking infrastructure allows for this improvement in the study environment. Data collected includes eye gazes on source code, written summaries, and time to complete each summary. Unlike prior work that concluded developers focus on the signature the most, these results indicate that they tend to focus on the method body more than the signature. Moreover, both experts and novices tend to revisit control flow terms rather than reading them for a long period. They also spend a significant amount of gaze time and have higher gaze visits when they read call terms. Experts tend to revisit the body of the method significantly more frequently than its signature as the size of the method increases. Moreover, experts tend to write their summaries from source code lines that they read the most.more » « less
-
In today’s rapidly evolving career climate, there is an increased need to foster student understanding and appreciation of the scientific method, as well as the higher-order cognitive skills that accompany this process. A partnership with ANP Technologies, a Delaware company that manufactures and produces products relating to environmental monitoring, has led to the development of a classroom-ready educational tool. This module uses a sequence that prompts students to engage, explore, explain, and evaluate while meeting various concepts within the Next Generation Science Standards. Located in Dover, Delaware, Wesley College is a minority-serving liberal arts institution where non-science majors are required to take a topical science course emphasizing scientific literacy. Prior to this project, there was no common instructional tools or assessment between the various class sections. The module developed in this project was piloted in the spring of 2019 along with a post-test to assess module effectiveness and consistency between sections. It was hypothesized that there would be no significant differences between average post-test scores of the different sections following the implementation of the module and that students would achieve proficiency (70% or higher) on at least half of the questions. Results confirmed the consistency between the sections as there were no significant differences in mean post-test score. Students were able to meet threshold on 7 of the 12 questions, suggesting this module could be useful in scientific literacy education.more » « less