skip to main content

This content will become publicly available on July 1, 2022

Title: Characterizing Variability in Shared Meaning through Millions of Sketches
The study of mental representations of concepts has histori- cally focused on the representations of the “average” person. Here, we shift away from this aggregate view and examine the principles of variability across people in conceptual rep- resentations. Using a database of millions of sketches by peo- ple worldwide, we ask what predicts whether people converge or diverge in their representations of a specific concept, and which kinds of concepts tend to be more or less variable. We find that larger and more dense populations tend to have less variable representations, and concepts high in valence and arousal tend to be less variable across people. Further, two countries tend to have people with more similar conceptual representations when they are linguistically, geographically, and culturally similar. Our work provides the first characteri- zation of the principles of variability in shared meaning across a large, diverse sample of participants.
; ; ;
Award ID(s):
Publication Date:
Journal Name:
Proceedings of the Annual Meeting of the Cognitive Science Society
Page Range or eLocation-ID:
Sponsoring Org:
National Science Foundation
More Like this
  1. Concept maps have emerged as a valid and reliable method for assessing deep conceptual understanding in engineering education within disciplines as well as interdisciplinary knowledge integration across disciplines. Most work on concept maps, however, focuses on undergraduates. In this paper, we use concept maps to examine changes in graduate students’ conceptual understanding and knowledge integration resulting from an interdisciplinary graduate program. Our study context is pair of foundational, team-taught courses in an interdisciplinary Disaster Resilience and Risk Management (DRRM) graduate program. The courses include a 3-hour research course and a 1-hour seminar that aim to build student understanding within andmore »across Urban Affairs and Planning, Civil and Environmental Engineering, Geosciences, and Business Information Technology. The courses introduce core principles of DRRM and relevant research methods in these disciplines, and drive students to understand the intersections of these disciplines in the context of planning for and responding to natural and human-made disasters. To understand graduate student growth from disciplinary-based to interdisciplinary scholars, we pose the research questions: 1) In what ways do graduate students’ understandings of DRRM change as a result of their introduction to an interdisciplinary graduate research program? and 2) To what extent and in what ways do concept maps serve as a tool to capture interdisciplinary learning in this context? Data includes pre/post concept maps centered on disaster resilience and risk management, a one-page explanation of the post-concept map, and ethnographic field notes gathered from class and faculty meetings. Pre-concept maps were collected on the first day of class; post-concept maps will be collected as part of the final course assignment. We assess the students’ concept maps for depth of conceptual understanding within disciplines and interdisciplinary competency across disciplines, using the field notes to provide explanatory context. The results presented in this paper support the inclusion of an explanation component to concept maps, and also suggest that concept maps alone may not be the best measure of student understanding of concepts within and across disciplines in this specific context. If similar programs wish to use concept maps as an assessment method, we suggest the inclusion of an explanation component and suggest providing explicit instructions that specify the intended audience. We also suggest using a holistic scoring method, as it is more likely to capture nuances in the concept maps than traditional scoring methods, which focus solely on counting factors like hierarchies and number of cross-links.« less
  2. The following is a Theory paper that presents an ethnographic exploration into how concepts are situated in workplace and classroom settings. Situated cognition research demonstrates that different contexts wherein learning occurs and knowledge is applied shape our conceptual understanding. Within engineering education and practice this means that practitioners, students, and instructors demonstrate different ways of representing their conceptual knowledge due to the different contexts wherein they learn and apply engineering concepts. The purpose of this paper is to present themes on how practitioners, students, and instructors represent fundamental structural engineering concepts within the contexts of structural engineering design. By representationmore »of concepts we mean the ways in which practitioners, students, and instructors portray and demonstrate their conceptual understanding of concepts through the social and material contexts of the workplace and classroom environments. Previous research on learning and engineering education has shown the influence that social and material contexts within these environments have on our knowing and understanding. The researchers use ethnographic methods consisting of workplace and classroom observations, interviews with practitioners, students, and instructors, and documentation of workplace and academic artifacts—such as drawings, calculations, and notes—to access practitioners’, students’, and instructors’ conceptual representations. These ethnographic methods are conducted at a private engineering firm and in 300 and 400 level structural engineering courses. Preliminary results indicate that instructors’ conceptual representations in the classroom aim to enhance students’ broader understanding of these concepts; whereas students’ conceptual representations are focused towards utility in solving homework and exam problems. Practitioners’ conceptual representations are more flexible and adapt to project and workplace constraints. These results seem to indicate that even when instructors emphasize broader conceptual knowledge, the academic incentives behind homework and test scores lead to more academically focused conceptual representations by students. Furthermore, practitioners’ conceptual representations indicate the necessity of conceptual fluency in the workplace, which contrasts with the rigidity of conceptual representations that students develop in the classroom. This comparison between workplace and academic conceptual representations enhances our understanding of the extent to which students, instructors, and practitioners share similar or different conceptual representations within the domain of structural engineering. This, in turn, may lead to guided curriculum reform efforts aimed at better preparing structural engineering students for their professional careers.« less
  3. Shaw, Shih-Lung ; Sui, Daniel (Ed.)
    When the World Health Organization (WHO) announced the pandemic of COVID-19, people around the globe scattered to stores for groceries, supplies, and other miscellaneous items in preparation for quarantine. The dynamics of retail visits changed dramatically due to the pandemic outbreak. The study intends to analyze how the store visit patterns have changed due to the lockdown policies during the COVID-19 pandemic. Using mobile phone location data, we build a time-aware Huff model to estimate and compare the visiting probability of different brands of stores over different time periods. We are able to identify certain retail and grocery stores thatmore »have more or fewer visits due to the pandemic outbreak, and we detect whether there are any trends in visiting certain retail establishments (e.g., department stores, grocery stores, fast-food restaurants, and cafes) and how the visiting patterns have adjusted with lockdowns. We also make comparisons among brands across three highly populated U.S. cities to identify potential regional variability. It has been found that people in large metropolitan areas with a well-developed transit system tend to show less sensitivity to long-distance visits. In addition, Target, which is a department store, is found to be more negatively affected by longer-distance trips than other grocery stores after the lockdown. The findings can be further applied to support policymaking related to public health, urban planning, transportation, and business in post-pandemic cities.« less
  4. Abstract: Jury notetaking can be controversial despite evidence suggesting benefits for recall and understanding. Research on note taking has historically focused on the deliberation process. Yet, little research explores the notes themselves. We developed a 10-item coding guide to explore what jurors take notes on (e.g., simple vs. complex evidence) and how they take notes (e.g., gist vs. specific representation). In general, jurors made gist representations of simple and complex information in their notes. This finding is consistent with Fuzzy Trace Theory (Reyna & Brainerd, 1995) and suggests notes may serve as a general memory aid, rather than verbatim representation.more »Summary: The practice of jury notetaking in the courtroom is often contested. Some states allow it (e.g., Nebraska: State v. Kipf, 1990), while others forbid it (e.g., Louisiana: La. Code of Crim. Proc., Art. 793). Some argue notes may serve as a memory aid, increase juror confidence during deliberation, and help jurors engage in the trial (Hannaford & Munsterman, 2001; Heuer & Penrod, 1988, 1994). Others argue notetaking may distract jurors from listening to evidence, that juror notes may be given undue weight, and that those who took notes may dictate the deliberation process (Dann, Hans, & Kaye, 2005). While research has evaluated the efficacy of juror notes on evidence comprehension, little work has explored the specific content of juror notes. In a similar project on which we build, Dann, Hans, and Kaye (2005) found jurors took on average 270 words of notes each with 85% including references to jury instructions in their notes. In the present study we use a content analysis approach to examine how jurors take notes about simple and complex evidence. We were particularly interested in how jurors captured gist and specific (verbatim) information in their notes as they have different implications for information recall during deliberation. According to Fuzzy Trace Theory (Reyna & Brainerd, 1995), people extract “gist” or qualitative meaning from information, and also exact, verbatim representations. Although both are important for helping people make well-informed judgments, gist-based understandings are purported to be even more important than verbatim understanding (Reyna, 2008; Reyna & Brainer, 2007). As such, it could be useful to examine how laypeople represent information in their notes during deliberation of evidence. Methods Prior to watching a 45-minute mock bank robbery trial, jurors were given a pen and notepad and instructed they were permitted to take notes. The evidence included testimony from the defendant, witnesses, and expert witnesses from prosecution and defense. Expert testimony described complex mitochondrial DNA (mtDNA) evidence. The present analysis consists of pilot data representing 2,733 lines of notes from 52 randomly-selected jurors across 41 mock juries. Our final sample for presentation at AP-LS will consist of all 391 juror notes in our dataset. Based on previous research exploring jury note taking as well as our specific interest in gist vs. specific encoding of information, we developed a coding guide to quantify juror note-taking behaviors. Four researchers independently coded a subset of notes. Coders achieved acceptable interrater reliability [(Cronbach’s Alpha = .80-.92) on all variables across 20% of cases]. Prior to AP-LS, we will link juror notes with how they discuss scientific and non-scientific evidence during jury deliberation. Coding Note length. Before coding for content, coders counted lines of text. Each notepad line with at minimum one complete word was coded as a line of text. Gist information vs. Specific information. Any line referencing evidence was coded as gist or specific. We coded gist information as information that did not contain any specific details but summarized the meaning of the evidence (e.g., “bad, not many people excluded”). Specific information was coded as such if it contained a verbatim descriptive (e.g.,“<1 of people could be excluded”). We further coded whether this information was related to non-scientific evidence or related to the scientific DNA evidence. Mentions of DNA Evidence vs. Other Evidence. We were specifically interested in whether jurors mentioned the DNA evidence and how they captured complex evidence. When DNA evidence was mention we coded the content of the DNA reference. Mentions of the characteristics of mtDNA vs nDNA, the DNA match process or who could be excluded, heteroplasmy, references to database size, and other references were coded. Reliability. When referencing DNA evidence, we were interested in whether jurors mentioned the evidence reliability. Any specific mention of reliability of DNA evidence was noted (e.g., “MT DNA is not as powerful, more prone to error”). Expert Qualification. Finally, we were interested in whether jurors noted an expert’s qualifications. All references were coded (e.g., “Forensic analyst”). Results On average, jurors took 53 lines of notes (range: 3-137 lines). Most (83%) mentioned jury instructions before moving on to case specific information. The majority of references to evidence were gist references (54%) focusing on non-scientific evidence and scientific expert testimony equally (50%). When jurors encoded information using specific references (46%), they referenced non-scientific evidence and expert testimony equally as well (50%). Thirty-three percent of lines were devoted to expert testimony with every juror including at least one line. References to the DNA evidence were usually focused on who could be excluded from the FBIs database (43%), followed by references to differences between mtDNA vs nDNA (30%), and mentions of the size of the database (11%). Less frequently, references to DNA evidence focused on heteroplasmy (5%). Of those references that did not fit into a coding category (11%), most focused on the DNA extraction process, general information about DNA, and the uniqueness of DNA. We further coded references to DNA reliability (15%) as well as references to specific statistical information (14%). Finally, 40% of jurors made reference to an expert’s qualifications. Conclusion Jury note content analysis can reveal important information about how jurors capture trial information (e.g., gist vs verbatim), what evidence they consider important, and what they consider relevant and irrelevant. In our case, it appeared jurors largely created gist representations of information that focused equally on non-scientific evidence and scientific expert testimony. This finding suggests note taking may serve not only to represent information verbatim, but also and perhaps mostly as a general memory aid summarizing the meaning of evidence. Further, jurors’ references to evidence tended to be equally focused on the non-scientific evidence and the scientifically complex DNA evidence. This observation suggests jurors may attend just as much to non-scientific evidence as they to do complex scientific evidence in cases involving complicated evidence – an observation that might inform future work on understanding how jurors interpret evidence in cases with complex information. Learning objective: Participants will be able to describe emerging evidence about how jurors take notes during trial.« less
  5. How do children’s representations of object categories change as they grow older? As they learn about the world around them, they also express what they know in the drawings they make. Here, we examine drawings as a window into how children represent familiar object categories, and how this changes across childhood. We asked children (age 3-10 years) to draw familiar object categories on an iPad. First, we analyzed their semantic content, finding large and consistent gains in how well children could produce drawings that are recognizable to adults. Second, we quantified their perceptual similarity to adult drawings using a pre-trainedmore »deep convolutional neural network, allowing us to visualize the representational layout of object categories across age groups using a common feature basis. We found that the organization of object categories in older children’s drawings were more similar to that of adults than younger children’s drawings. This correspondence was strong in the final layers of the neural network, showing that older children’s drawings tend to capture the perceptual features critical for adult recognition. We hypothesize that this improvement reflects increasing convergence between children’s representations of object categories and that of adults; future work will examine how these age-related changes relate to children’s developing perceptual and motor capacities. Broadly, these findings point to drawing as a rich source of insight into how children represent object concepts.« less