An official website of the United States government
Abstract Theories and practices to enhance multiple document comprehension and integration are crucial in both personal and work contexts, especially with the proliferation of printed and online sources. This experimental investigation replicates and extends (Wei et al., Educational Technology Research and Development 72:661–685, 2024) to examine how multiple documents integration is influenced by reading purpose, summary writing, and extra-textual networks (pre-reading, Study 1, and post-writing, Study 2). In Study 1 (N = 102), participants were randomly assigned to a pre-reading purpose set by a prompt (integrative or detailed) and by a network (an integrative or else an intra-text network) and then read three documents about Alzheimer’s disease to complete a writing task with revision (but no feedback). Three days later, they completed a delayed writing task and an inference verification test. In Study 2 (N = 90), the same procedure was used except that the network was used as feedback after writing to support revision. Results from the two studies agree with the previous research that the quantity and structural quality of integration can be improved by external cues and by delayed repeated writing. This research further confirms an innovative approach for evaluating different aspects of knowledge integration and contributes to the literature from the concept network perspective as a measure and an intervention of multiple-text reading.
more »
« less
The effects of reading prompts and of post-reading generative learning tasks on multiple document integration: evidence from concept network analysis
Learning from multiple documents is an essential ability in today's society. This experimental study used concept network analysis to consider how reading prompts and post-reading generative learning tasks alter students' document integration performance. Undergraduates (N = 119) read three documents about Alzheimer's disease with one of two reading prompts (integrative purpose vs. detailed purpose) and then after reading completed a generative learning task (concept mapping vs. summary writing). Three days later they completed a delayed writing task and an inference verification test. Participants' written texts were converted to concept networks to evaluate conceptual level integration, including the quantity of integration (measured by the proportion of integrative links), the semantic quality of integration (measured by the similarity of integrative links), and the structural quality of integration (measured by comparing graph centrality). Results showed that the integrative purpose relative to the detailed purpose enhanced the quantity of integration but not the semantic and structural quality. Further, concept mapping relative to summary writing significantly improved the structural quality of integration. In addition, this study provides a new approach for evaluating different aspects of integration and contributes to multiple document comprehension literature from the perspective of concept network analysis.
more »
« less
- Award ID(s):
- 2215807
- PAR ID:
- 10504598
- Publisher / Repository:
- Springer
- Date Published:
- Journal Name:
- Educational technology research and development
- ISSN:
- 1042-1629
- Page Range / eLocation ID:
- https://doi.org/10.1007/s11423-023-10326-w
- Subject(s) / Keyword(s):
- multiple documents integration concept network analysis
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
As an important step in the development of browser-based writing-to-learn software that provides immediate structural feedback, we seek ways to improve the quality of students essays and to optimize the software analysis algorithm. This quasi-experimental investigation compares the quality of students’ summary writing under three writing prompt conditions, otherwise identical prompts add either 0, 14, or 26 key terms. Results show that key terms matters substantially – the summary essays of those given the prompt without key terms had longer essays and the resulting networks of those essays were more like the expert referent and like their peers’ essays. Although tentative, these results indicate that writing prompts should NOT include key terms.more » « less
-
Abstract The lexical quality hypothesis proposes that the quality of phonological, orthographic, and semantic representations impacts reading comprehension. In Study 1, we evaluated the contributions of lexical quality to reading comprehension in 97 deaf and 98 hearing adults matched for reading ability. While phonological awareness was a strong predictor for hearing readers, for deaf readers, orthographic precision and semantic knowledge, not phonology, predicted reading comprehension (assessed by two different tests). For deaf readers, the architecture of the reading system adapts by shifting reliance from (coarse-grained) phonological representations to high-quality orthographic and semantic representations. In Study 2, we examined the contribution of American Sign Language (ASL) variables to reading comprehension in 83 deaf adults. Fingerspelling (FS) and ASL comprehension skills predicted reading comprehension. We suggest that FS might reinforce orthographic-to-semantic mappings and that sign language comprehension may serve as a linguistic basis for the development of skilled reading in deaf signers.more » « less
-
Researchers read scientific literature to keep current in the field and find state-of-the-art solutions to various scientific problems. Prior work suggests that reading patterns may vary with the researcher’s domain expertise and on the content of the digital document. In this work, we present a pilot study of eye-tracking measures during a reading task with the options for zooming and panning of the reading material. The main goal is to analyze unconstrained reading patterns of digital documents using eye movement fixations and dwell time on various sections of a digital document. Our results indicate that participants mostly focused on methodology and results sections, which is consistent with the prior work with constrained reading patterns.more » « less
-
This investigation is the first of four investigations funded by the NSF (DUE award 2215807) to develop and then field test on open educational browser-based writing-to-learn tool called GIKS. The underlying theory is that writing-to-learn with immediate formative feedback presented as concept networks is engaging and effective for learning concepts covered in lectures. This work was studied in a second year architectural engineering course focusing on building materials, processes and modeling. Participants (n=84) completed a lesson (readings, lecture, and labs) then followed by writing prompts centered on the following topics: Building with Concrete and Wood Construction (3 weeks later). Participants were assigned to one of two counterbalanced groups, group A used GIKS software to write a 300-word summary of the first lesson but did not write in the second lesson, while group B did not write in the first lesson but used GIKS in the second lesson, so that each group served as a control treatment for the other group. All students completed a concept structure survey at the end of each lesson that contained 20 key concepts from that lesson, the two concept structure surveys’ data were transformed into concept networks and then these networks were compared to an expert network benchmark referent, as well as to networks of the textbook chapter and the PowerPoint slides of the related lesson. Then a week after the second lesson students completed the standing end-of-module multiple-choice posttest that included items from these lesson as well as from other lessons in the module. Results to date highlight that for both lessons, the group using GIKS scored higher on the concept structure survey (more like the expert network) BUT lower on the multiple-choice test, the difference was significant for the Building with Concrete lesson (p < .05) but not for the Wood Construction lesson. This interaction has been reported before by Ntshalintshali & Clariana (2020), that improving conceptual knowledge sometimes decreases memory of lesson details. Descriptive analysis of the group-average networks derived from the concept structure surveys for Building with Concrete show that the group-averaged network of those using GIKS compared to the control was more like the expert network (54% vs. 36%), the network of the textbook Chapter (32% vs. 29%), the network of the PowerPoint (PP) (46% vs. 41%), and especially like peers in the other group (67%). For Wood Construction the difference between the groups was less, the group-averaged network of those using GIKS compared to the control was more like the expert (40% vs. 39%), like the light-framed construction PP (28% vs. 24%), and especially like peers in the other group (72%). These findings show that writing-to-learn with GIKS with immediate network feedback improves conceptual knowledge as expected but at the cost of details. Peers conceptual structure of the lesson materials were very similar (peer-peer mental model convergence) and were more like others than like the expert, or the book chapters, or the PowerPoint slides; in addition, the PowerPoint slides appear to influence conceptual structure more than the textbook chapters. Investigation 2 will consider writing-to-learn with or without immediate network feedback in order to isolate the effects of immediate network feedback.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1007/s11423-023-10326-w
