skip to main content


Title: Sketching, Summarizing, and Science: Reducing the Impact of Seductive Details
The presence of irrelevant information in expository text can harm comprehension. This study examined the role of a post-reading sketching task for reducing the negative impact of seductive details on learning and recall. Results indicated that while sketching did not improve conceptual recall, it did reduce seductive recall. Students who wrote post-reading summaries recalled the most core concepts. These results inform how to support learning from naturalistic science text in spite of distracting details.  more » « less
Award ID(s):
1640800
NSF-PAR ID:
10054891
Author(s) / Creator(s):
; ;
Date Published:
Journal Name:
Society for Text and Discourse 2017
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Drawing on What Matters: Sketching Reduces Memory for Seductive Details. ALLISON J. JAEGER, ANASTASIA DAWDANOW and THOMAS F. SHIPLEY, Temple University — Seductive details are interesting pieces of information in expository text that are non-essential to the target concepts and can result in reduced comprehension (Garner, Gillingham, & White, 1989). Previous work has unsuccessfully attempted to reduce the impact of seductive details through various manipulations. Research suggests sketching is beneficial for science learning and can improve learning from science text (Ainsworth et al., 2011). The current experiment tested whether a post-reading sketching task could reduce the negative impact of seductive details and facilitate learning from a geology text. Results indicated that the presence of seductive details reduced recall of target concepts compared to a plain text. While sketching did not lead to higher recall of target concepts compared to summarizing, those who sketched recalled fewer seductive details. This suggests that sketching may help to focus attention on more relevant information in expository text. Interactions with spatial skills will also be discussed. Email: Allison J. Jaeger, allison.jaeger@temple.edu 
    more » « less
  2. Abstract: Jury notetaking can be controversial despite evidence suggesting benefits for recall and understanding. Research on note taking has historically focused on the deliberation process. Yet, little research explores the notes themselves. We developed a 10-item coding guide to explore what jurors take notes on (e.g., simple vs. complex evidence) and how they take notes (e.g., gist vs. specific representation). In general, jurors made gist representations of simple and complex information in their notes. This finding is consistent with Fuzzy Trace Theory (Reyna & Brainerd, 1995) and suggests notes may serve as a general memory aid, rather than verbatim representation. Summary: The practice of jury notetaking in the courtroom is often contested. Some states allow it (e.g., Nebraska: State v. Kipf, 1990), while others forbid it (e.g., Louisiana: La. Code of Crim. Proc., Art. 793). Some argue notes may serve as a memory aid, increase juror confidence during deliberation, and help jurors engage in the trial (Hannaford & Munsterman, 2001; Heuer & Penrod, 1988, 1994). Others argue notetaking may distract jurors from listening to evidence, that juror notes may be given undue weight, and that those who took notes may dictate the deliberation process (Dann, Hans, & Kaye, 2005). While research has evaluated the efficacy of juror notes on evidence comprehension, little work has explored the specific content of juror notes. In a similar project on which we build, Dann, Hans, and Kaye (2005) found jurors took on average 270 words of notes each with 85% including references to jury instructions in their notes. In the present study we use a content analysis approach to examine how jurors take notes about simple and complex evidence. We were particularly interested in how jurors captured gist and specific (verbatim) information in their notes as they have different implications for information recall during deliberation. According to Fuzzy Trace Theory (Reyna & Brainerd, 1995), people extract “gist” or qualitative meaning from information, and also exact, verbatim representations. Although both are important for helping people make well-informed judgments, gist-based understandings are purported to be even more important than verbatim understanding (Reyna, 2008; Reyna & Brainer, 2007). As such, it could be useful to examine how laypeople represent information in their notes during deliberation of evidence. Methods Prior to watching a 45-minute mock bank robbery trial, jurors were given a pen and notepad and instructed they were permitted to take notes. The evidence included testimony from the defendant, witnesses, and expert witnesses from prosecution and defense. Expert testimony described complex mitochondrial DNA (mtDNA) evidence. The present analysis consists of pilot data representing 2,733 lines of notes from 52 randomly-selected jurors across 41 mock juries. Our final sample for presentation at AP-LS will consist of all 391 juror notes in our dataset. Based on previous research exploring jury note taking as well as our specific interest in gist vs. specific encoding of information, we developed a coding guide to quantify juror note-taking behaviors. Four researchers independently coded a subset of notes. Coders achieved acceptable interrater reliability [(Cronbach’s Alpha = .80-.92) on all variables across 20% of cases]. Prior to AP-LS, we will link juror notes with how they discuss scientific and non-scientific evidence during jury deliberation. Coding Note length. Before coding for content, coders counted lines of text. Each notepad line with at minimum one complete word was coded as a line of text. Gist information vs. Specific information. Any line referencing evidence was coded as gist or specific. We coded gist information as information that did not contain any specific details but summarized the meaning of the evidence (e.g., “bad, not many people excluded”). Specific information was coded as such if it contained a verbatim descriptive (e.g.,“<1 of people could be excluded”). We further coded whether this information was related to non-scientific evidence or related to the scientific DNA evidence. Mentions of DNA Evidence vs. Other Evidence. We were specifically interested in whether jurors mentioned the DNA evidence and how they captured complex evidence. When DNA evidence was mention we coded the content of the DNA reference. Mentions of the characteristics of mtDNA vs nDNA, the DNA match process or who could be excluded, heteroplasmy, references to database size, and other references were coded. Reliability. When referencing DNA evidence, we were interested in whether jurors mentioned the evidence reliability. Any specific mention of reliability of DNA evidence was noted (e.g., “MT DNA is not as powerful, more prone to error”). Expert Qualification. Finally, we were interested in whether jurors noted an expert’s qualifications. All references were coded (e.g., “Forensic analyst”). Results On average, jurors took 53 lines of notes (range: 3-137 lines). Most (83%) mentioned jury instructions before moving on to case specific information. The majority of references to evidence were gist references (54%) focusing on non-scientific evidence and scientific expert testimony equally (50%). When jurors encoded information using specific references (46%), they referenced non-scientific evidence and expert testimony equally as well (50%). Thirty-three percent of lines were devoted to expert testimony with every juror including at least one line. References to the DNA evidence were usually focused on who could be excluded from the FBIs database (43%), followed by references to differences between mtDNA vs nDNA (30%), and mentions of the size of the database (11%). Less frequently, references to DNA evidence focused on heteroplasmy (5%). Of those references that did not fit into a coding category (11%), most focused on the DNA extraction process, general information about DNA, and the uniqueness of DNA. We further coded references to DNA reliability (15%) as well as references to specific statistical information (14%). Finally, 40% of jurors made reference to an expert’s qualifications. Conclusion Jury note content analysis can reveal important information about how jurors capture trial information (e.g., gist vs verbatim), what evidence they consider important, and what they consider relevant and irrelevant. In our case, it appeared jurors largely created gist representations of information that focused equally on non-scientific evidence and scientific expert testimony. This finding suggests note taking may serve not only to represent information verbatim, but also and perhaps mostly as a general memory aid summarizing the meaning of evidence. Further, jurors’ references to evidence tended to be equally focused on the non-scientific evidence and the scientifically complex DNA evidence. This observation suggests jurors may attend just as much to non-scientific evidence as they to do complex scientific evidence in cases involving complicated evidence – an observation that might inform future work on understanding how jurors interpret evidence in cases with complex information. Learning objective: Participants will be able to describe emerging evidence about how jurors take notes during trial. 
    more » « less
  3. Abstract

    This study used eye-tracking to examine whether extraneous illustration details—a common design in beginning reader storybooks—promote attentional competition and hinder learning. The study used a within-subject design with first- and second-grade children. Children (n = 60) read a story in a commercially available Standard condition and in a Streamlined condition, in which extraneous illustrations were removed while an eye-tracker recorded children’s gaze shifts away from the text, fixations to extraneous illustrations, and fixations to relevant illustrations. Extraneous illustrations promoted attentional competition and hindered reading comprehension: children made more gaze shifts away from text in the Standard compared to the Streamlined condition, and reading comprehension was significantly higher in the Streamlined condition compared to the Standard condition. Importantly, fixations toward extraneous details accounted for the unique variance in reading comprehension controlling for reading proficiency and attending to relevant illustrations. Furthermore, a follow-up control experiment (n = 60) revealed that these effects did not solely stem from enhanced text saliency in the Streamlined condition and reproduced the finding of a negative relationship between fixations to extraneous details and reading comprehension. This study provides evidence that the design of reading materials can be optimized to promote literacy development in young children.

     
    more » « less
  4. Summary

    Many studies have demonstrated that illustrating expository science texts with images that are interesting, but irrelevant for understanding the causal relations underlying scientific phenomena, can cause seduction effects, which can reduce understanding from text. The term “seduction effects” refers to the influence that images are thought to have on readers, seducing them away from deeply processing important information. The present study explores whether images relevant for instructional goals may also show some seduction effects. In this study, the presence of photographic images negatively impacted understanding compared with the presence of relevant animations or instructing students to sketch a drawing during reading. However, the results showed that both photographic images and relevant animations could lead to illusions of understanding, whereas sketching did not. The results suggest that even images that are relevant for instructional goals may sometimes result in seduction effects that deceive readers when judging their own understanding.

     
    more » « less
  5. null (Ed.)
    Software engineers are crowdsourcing answers to their everyday challenges on Q&A forums (e.g., Stack Overflow) and more recently in public chat communities such as Slack, IRC, and Gitter. Many software-related chat conversations contain valuable expert knowledge that is useful for both mining to improve programming support tools and for readers who did not participate in the original chat conversations. However, most chat platforms and communities do not contain built-in quality indicators (e.g., accepted answers, vote counts). Therefore, it is difficult to identify conversations that contain useful information for mining or reading, i.e., conversations of post hoc quality. In this article, we investigate automatically detecting developer conversations of post hoc quality from public chat channels. We first describe an analysis of 400 developer conversations that indicate potential characteristics of post hoc quality, followed by a machine learning-based approach for automatically identifying conversations of post hoc quality. Our evaluation of 2,000 annotated Slack conversations in four programming communities (python, clojure, elm, and racket) indicates that our approach can achieve precision of 0.82, recall of 0.90, F-measure of 0.86, and MCC of 0.57. To our knowledge, this is the first automated technique for detecting developer conversations of post hoc quality. 
    more » « less