skip to main content

Title: Enhancing cognitive assessment through multimodal sensing: A case study using the block design test
Many cognitive assessments are limited by their reliance on relatively sparse measures of performance, like per-item accuracy or reaction time. Capturing more detailed behavioral measurements from cognitive assessments will enhance their utility in many settings, from individual clinical evaluations to large-scale research studies. We demonstrate the feasibility of combining scene and gaze cameras with supervised learning algorithms to automatically measure key behaviors on the block design test, a widely used test of visuospatial cognitive ability. We also discuss how this block-design measurement system could enhance the assessment of many critical cognitive and meta-cognitive functions such as attention, planning, progress monitoring, and strategy selection.
; ; ; ; ;
Award ID(s):
Publication Date:
Journal Name:
Proceedings of the 42nd Annual Meeting of the Cognitive Science Society
Page Range or eLocation-ID:
Sponsoring Org:
National Science Foundation
More Like this
  1. The block design test (BDT), in which a person has to recreate a visual design using colored blocks, is notable among cognitive assessments because it makes so much of a person's problem-solving strategy ``visible'' through their ongoing manual actions. While, for decades, numerous pockets of research on the BDT have identified certain behavioral variables as being important for certain cognitive or neurological hypotheses, there is no unifying framework for bringing together this spread of variables and hypotheses. In this paper, we identify 25 independent and dependent variables that have been examined as part of published BDT studies across many areas of cognitive science and present a sample of the research on each one. We also suggest variables of interest for future BDT research, especially as made possible with the advent of advanced recording technologies like wearable eye trackers.
  2. Recent reforms in science education have supported the inclusion of engineering in K- 12 curricula. To this end, many science classrooms have incorporated engineering units that include design tasks. Design is an integral part of engineering and helps students think in creative and interdisciplinary ways. In this study, we examined middle-school students’ naturally occurring design conversations in small design teams and their learning of science as a result of engaging in an engineering and science unit. We found that the proportion of different thought processes used by boys and girls was quite similar. Both girls and boys produced a higher percentage of ideas or thoughts associated with divergent thinking, but a lower proportion in convergent thinking, evaluative thinking, and cognitive memory. In addition, gender composition of design teams influenced thought processes expressed by girls and boys. Interestingly, in mixed teams, both girls and boys expressed less divergent thinking than those in single-sex teams. With regard to science content learning, both girls and boys showed statistically significant learning gains. There were no significant gender differences in the pre- and post-test scores. These results suggest that participating in an engineering design task in small design teams provided students opportunities to engage inmore »productive thinking and enhance their learning of the targeted science concept—ecosystems.« less
  3. Children’s math self-concepts—their beliefs about themselves and math—are important for teachers, parents, and students, because they are linked to academic motivation, choices, and outcomes. There have been several attempts at improving math achievement based on the training of math skills. Here we took a complementary approach and conducted an intervention study to boost children’s math self-concepts. Our primary objective was to assess the feasibility of whether a novel multicomponent intervention—one that combines explicit and implicit approaches to help children form more positive beliefs linking themselves and math—can be administered in an authentic school setting. The intervention was conducted in Spain, a country in which math achievement is below the average of other OECD countries. We tested third grade students ( N = 180; M age = 8.79 years; 96 girls), using treatment and comparison groups and pre- and posttest assessments. A novelty of this study is that we used both implicit and explicit measures of children’s math self-concepts. For a subsample of students, we also obtained an assessment of year-end math achievement. Math self-concepts in the treatment and comparison groups did not significantly differ at pretest. Students in the treatment group demonstrated a significant increase in math self-concepts from pretestmore »to posttest; students in the comparison group did not. In the treatment group, implicit math self-concepts at posttest were associated with higher year-end math achievement, assessed approximately 3 months after the completion of the intervention. Taken together, the results suggest that math self-concepts are malleable and that social–cognitive interventions can boost children’s beliefs about themselves and math. Based on the favorable results of this feasibility study, it is appropriate to formally test this novel multicomponent approach for improving math self-concepts using randomized controlled trial (RCT) design.« less
  4. Transcranial direct current stimulation (tDCS) over the dorsolateral prefrontal cortex (DLPFC) has been shown to enhance divergent and convergent creative thinking. Yet, how stimulation impacts creative performance over time, and what cognitive mechanisms underlie any such enhancement, remain largely unanswered questions. In the present research, we aimed to (1) verify the impact of DLPFC tDCS on both convergent and divergent thinking, and further investigated (2) the temporal dynamics of divergent thinking, focusing on the serial order effect (i.e., the tendency for ideas to become more original and less frequent over time), and (3) any role that cognitive inhibition may play in mediating any effect of stimulation on creative thinking (considering the DLPFC’s involvement in driving inhibitory processes that are also relevant for creative thinking). In a within-subjects design, twenty-six participants received three types of cross-hemispheric tDCS stimulation over the DLPFC (left cathodal and right anodal, L-R+; left anodal and right cathodal, L+R-; and sham). Before stimulation, they completed a pre-flanker task measuring cognitive inhibition; during stimulation, they completed the Alternate Uses Task (AUT), Remote Associates Test (RAT), and post-flanker task. Results showed that, compared with the sham stimulation, originality of responses in the AUT was significantly enhanced in the L+R-more »condition, while no tDCS effect was observed for the RAT. Additionally, compared with the other stimulation conditions, we found a diminished serial order effect in the L+R- condition characterized by an accelerated production of more original ideas. Critically, the L+R- condition was accompanied by better performance on the flanker task. Our findings thus verify that L+R- tDCS over the DLPFC accelerates idea originality also providing tentative clues that inhibition may act as a cognitive mechanism underlying enhancements in divergent thinking resulting from frontal lobe neuromodulation.« less
  5. Most undergraduate civil engineering programs include an introductory course in reinforced concrete design. The course generally includes an introduction to the fundamentals of reinforced concrete behavior, the design of simple beams and one-way slabs to resist shear and flexure, and the design of short columns. Because of the scale of typical civil engineering structures, students commonly do not get to experience large or full-scale structural behavior as a part of an undergraduate reinforced concrete course. Rather, students typically learn fundamental concepts through theoretical discussions, small demonstrations, or pictures and images. Without the interaction with full-scale structural members, students can struggle to develop a clear understanding of the fundamental behavior of these systems such as the differences in behavior of an over or under-reinforced beam. Additionally, students do not build an appreciation for the variations between as-built versus theoretical designs. Large-scale models can illustrate such behavior and enhance student understanding, but most civil engineering programs lack the physical equipment to perform testing at this scale. The authors from St. Louis University (SLU) and Rose-Hulman Institute of Technology (RHIT) have designed and implemented large-scale tests for in-class use that allow students to experience fundamental reinforced concrete behavior. Students design and test severalmore »reinforced concrete members using a modular strong-block testing system. This paper provides a detailed overview of the design, fabrication, and implementation of three large-scale experiential learning modules for an undergraduate reinforced concrete design course. The first module focuses on service load and deflections of a reinforced concrete beam. The first and second modules also focus on flexural failure modes and ductility. The third module focuses on shear design and failure modes. Each module uses a large scale reinforced concrete beam (Flexure specimens: 12 in. x 14 in. x 19 ft, Shear specimens: 12 in. x 14 in. x 10 ft.) that was tested on a modular strong-block testing system. The three modules were used throughout the reinforced concrete design course at SLU and RHIT to illustrate behavior concurrent to the presentation of various reinforced concrete design concepts.« less