Do people have dispositions towards visual or verbal thinking styles, i.e., a tendency towards one default representational modality versus the other? The problem in trying to answer this question is that visual/verbal thinking styles are challenging to measure. Subjective, introspective measures are the most common but often show poor reliability and validity; neuroimaging studies can provide objective evidence but are intrusive and resource-intensive. In previous work, we observed that in order for a purely behavioral testing method to be able to objectively evaluate a person’s visual/verbal thinking style, 1) the task must be solvable equally well using either visual or verbal mental representations, and 2) it must offer a secondary behavioral marker, in addition to primary performance measures, that indicates which modality is being used. We collected four such tasks from the psychology literature and conducted a small pilot study with adult participants to see the extent to which visual/verbal thinking styles can be differentiated using an individual’s results on these tasks.
more »
« less
A potential mechanism for Gibsonian resonance: behavioral entrainment emerges from local homeostasis in an unsupervised reservoir network
While the cognitivist school of thought holds that the mind is analogous to a computer, performing logical operations over
internal representations, the tradition of ecological psychology contends that organisms can directly ‘‘resonate’’ to
information for action and perception without the need for a representational intermediary. The concept of resonance has
played an important role in ecological psychology, but it remains a metaphor. Supplying a mechanistic account of
resonance requires a non-representational account of central nervous system (CNS) dynamics. Towards this, we present a
series of simple models in which a reservoir network with homeostatic nodes is used to control a simple agent embedded in
an environment. This network spontaneously produces behaviors that are adaptive in each context, including (1) visually
tracking a moving object, (2) substantially above-chance performance in the arcade game Pong, (2) and avoiding walls
while controlling a mobile agent. Upon analyzing the dynamics of the networks, we find that behavioral stability can be
maintained without the formation of stable or recurring patterns of network activity that could be identified as neural
representations. These results may represent a useful step towards a mechanistic grounding of resonance and a view of the
CNS that is compatible with ecological psychology.
more »
« less
- Award ID(s):
- 1849446
- NSF-PAR ID:
- 10514653
- Publisher / Repository:
- Springer Nature
- Date Published:
- Journal Name:
- Cognitive Neurodynamics
- ISSN:
- 1871-4080
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Comparing representations of complex stimuli in neural network layers to human brain representations or behavioral judgments can guide model development. However, even qualitatively distinct neural network models often predict similar representational geometries of typical stimulus sets. We propose a Bayesian experimental design approach to synthesizing stimulus sets for adjudicating among representational models efficiently. We apply our method to discriminate among candidate neural network models of behavioral face dissimilarity judgments. Our results indicate that a neural network trained to invert a 3D-face-model graphics renderer is more human-aligned than the same architecture trained on identification, classification, or autoencoding. Our proposed stimulus synthesis objective is generally applicable to designing experiments to be analyzed by representational similarity analysis for model comparison.more » « less
-
This paper proposes a representational model for image pairs such as consecutive video frames that are related by local pixel displacements, in the hope that the model may shed light on motion perception in primary visual cortex (V1). The model couples the following two components: (1) the vector representations of local contents of images and (2) the matrix representations of local pixel displacements caused by the relative motions between the agent and the objects in the 3D scene. When the image frame undergoes changes due to local pixel displacements, the vectors are multiplied by the matrices that represent the local displacements. Thus the vector representation is equivariant as it varies according to the local displacements. Our experiments show that our model can learn Gabor-like filter pairs of quadrature phases. The profiles of the learned filters match those of simple cells in Macaque V1. Moreover, we demonstrate that the model can learn to infer local motions in either a supervised or unsupervised manner. With such a simple model, we achieve competitive results on optical flow estimation.more » « less
-
Pater’s (2018) expansive review is a significant contribution towards bridging the disconnect of generative linguistics with connectionism, and as such, it is an important service to the field. But Pater’s efforts for inclusion and reconciliation obscure crucial substantive disagreements on foundational matters. Most connectionist models are antithetical to the algebraic hypothesis that has guided generative linguistics from its inception. They eschew the notions that mental representations have formal constituent structure and that mental operations are structure-sensitive. These representational commitments critically limit the scope of learning and productivity in connectionist models. Moving forward, we see only two options: either those connectionist models are right, and generative linguistics must be radically revised, or they must be replaced by alternatives that are compatible with the algebraic hypothesis. There can be no integration without structured representations.more » « less
-
Modern 3D printing technology makes it relatively easy and affordable to produce physical models that offer learners concrete representations of otherwise abstract concepts and representations. We hypothesize that integrating hands-on learning with these models into traditionally lecture-dominant courses may help learners develop representational competence, the ability to interpret, switch between, and appropriately use multiple representations of a concept as appropriate for learning, communication and analysis. This approach also offers potential to mitigate difficulties that learners with lower spatial abilities may encounter in STEM courses. Spatial thinking connects to representational competence in that internal mental representations (i.e. visualizations) facilitate work using multiple external representations. A growing body of research indicates well-developed spatial skills are important to student success in many STEM majors, and that students can improve these skills through targeted training. This NSF-IUSE exploration and design project began in fall 2018 and features cross-disciplinary collaboration between engineering, math, and psychology faculty to develop learning activities with 3D-printed models, build the theoretical basis for how they support learning, and assess their effectiveness in the classroom. We are exploring how such models can support learners’ development of conceptual understanding and representational competence in calculus and engineering statics. We are also exploring how to leverage the model-based activities to embed spatial skills training into these courses. The project is addressing these questions through parallel work piloting model-based learning activities in the classroom and by investigating specific attributes of the activities in lab studies and focus groups. To date we have developed and piloted a mature suite of activities covering a variety of topics for both calculus and statics. Class observations and complementary studies in the psychology lab are helping us develop a theoretical framework for using the models in instruction. Close observation of how students use the models to solve problems and as communication tools helps identify effective design elements. We are administering two spatial skills assessments as pre/post instruments: the Purdue Spatial Visualizations Test: Rotations (PSVT:R) in calculus; and the Mental Cutting Test (MCT) in statics. We are also developing strategies and refining approaches for assessing representational competence in both subject areas. Moving forward we will be using these assessments in intervention and control sections of both courses to assess the effectiveness of the models for all learners and subgroups of learners.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.1007/s11571-023-09988-2
