An official website of the United States government
The block design test (BDT) has been used for over a century in research and clinical contexts as a measure of spatial cognition, both as a singular ability and as part of more comprehensive intelligence assessment. Traditionally, the BDT has been scored using methods that do not reflect the full potential of individual differences that could be measured by the test. Recent advancements in technology, including eye-tracking, embedded sensor systems, and artificial intelligence, have provided new opportunities to measure and analyze data from the BDT. In this methodological review, we outline the information that BDT can assess, review several recent advancements in measurement and analytic methods, discuss potential future uses of these methods, and advocate for further research using these methods.
more »
« less
Measuring More to Learn More From the Block Design Test: A Literature Review
The block design test (BDT), in which a person has to recreate a visual design using colored blocks, is notable among cognitive assessments because it makes so much of a person's problem-solving strategy ``visible'' through their ongoing manual actions. While, for decades, numerous pockets of research on the BDT have identified certain behavioral variables as being important for certain cognitive or neurological hypotheses, there is no unifying framework for bringing together this spread of variables and hypotheses. In this paper, we identify 25 independent and dependent variables that have been examined as part of published BDT studies across many areas of cognitive science and present a sample of the research on each one. We also suggest variables of interest for future BDT research, especially as made possible with the advent of advanced recording technologies like wearable eye trackers.
more »
« less
- Award ID(s):
- 2034013
- PAR ID:
- 10291682
- Date Published:
- Journal Name:
- Proceedings of the Annual Conference of the Cognitive Science Society
- Volume:
- 43
- ISSN:
- 1069-7977
- Page Range / eLocation ID:
- 611-617
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
null (Ed.)Abstract Product/service systems (PSSs) are increasingly found in markets, and more resources are being invested in PSS design. Despite the substantial research into PSS design, the current literature exhibits an incomplete understanding of it as a cognitive activity. This article demonstrates that the methods used to analyze product designers’ cognitive behavior can be used to produce comparable and commensurable results when analyzing PSS designers. It also generates empirical grounding for the development of hypotheses based on a cognitive study of a PSS design session in a laboratory environment using protocol analysis. This study is a part of a larger project comparing PSS design with product design. The results, which are based on the function–behavior–structure coding scheme, show that PSS design, when coded using this scheme, can be quantitatively compared with product design. Five hypotheses were developed based on the results of the study of this design session concerning where and how designers expend their cognitive design effort. These hypotheses can be used to design experiments that test them and provide the grounding for a fuller understanding of PSS design.more » « less
-
Abstract International large-scale assessments (ILSAs) play an important role in educational research and policy making. They collect valuable data on education quality and performance development across many education systems, giving countries the opportunity to share techniques, organisational structures, and policies that have proven efficient and successful. To gain insights from ILSA data, we identify non-cognitive variables associated with students’ academic performance. This problem has three analytical challenges: (a) academic performance is measured by cognitive items under a matrix sampling design; (b) there are many missing values in the non-cognitive variables; and (c) multiple comparisons due to a large number of non-cognitive variables. We consider an application to the Programme for International Student Assessment, aiming to identify non-cognitive variables associated with students’ performance in science. We formulate it as a variable selection problem under a general latent variable model framework and further propose a knockoff method that conducts variable selection with a controlled error rate for false selections.more » « less
-
For someone with Autism Spectrum Disorder, performance on tasks that require coordinated motor and cognitive activities, such as walking while talking (or texting) on our phones, can take substantially more effort to accomplish. While it is more common to isolate and examine motor and cognitive skill in separate experiments, we propose a dual task experiment to allow us to examine performance in people with autism more realistically. We designed a system composed of three task types and accompanying hardware to simultaneously quantify balance, fine motor skill, and cognitive ability. We hypothesized that the additional demands of the balance and speeded finger-tapping tasks would degrade motor performance in the simultaneous conditions, but not impact cognitive (N-Back task) performance. Movement data were evaluated by comparing the change of each group across 3 levels of cognitive load (0-, 1-, and 2-back). We tested the task on a small sample of young adults with autism spectrum disorder (ASD; n=4) and matched controls (n=4). We observed a trend largely consistent with our hypotheses. The system's temporal precision and modular design also allow for the incorporation of other sensors as needed, like EEG or heart rate variability. We propose that a version of this system be tested as a putative outcome measure for interventions involving attention, cognitive load or certain types of motor skill training.more » « less
-
Abstract This paper presents a framework to describe and explain human-machine collaborative design focusing on Design Space Exploration (DSE), which is a popular method used in the early design of complex systems with roots in the well-known design as exploration paradigm. The human designer and a cognitive design assistant are both modeled as intelligent agents, with an internal state (e.g., motivation, cognitive workload), a knowledge state (separated in domain, design process, and problem specific knowledge), an estimated state of the world (i.e., status of the design task) and of the other agent, a hierarchy of goals (short-term and long-term, design and learning goals) and a set of long-term attributes (e.g., Kirton’s Adaption-Innovation inventory style, risk aversion). The framework emphasizes the relation between design goals and learning goals in DSE, as previously highlighted in the literature (e.g., Concept-Knowledge theory, LinD model) and builds upon the theory of common ground from human-computer interaction (e.g., shared goals, plans, attention) as a building block to develop successful assistants and interactions. Recent studies in human-AI collaborative DSE are reviewed from the lens of the proposed framework, and some new research questions are identified. This framework can help advance the theory of human-AI collaborative design by helping design researchers build promising hypotheses, and design studies to test these hypotheses that consider most relevant factors.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
