An official website of the United States government
Modeling is an important aspect of scientific problem-solving. How- ever, modeling is a difficult cognitive process for novice learners in part due to the high dimensionality of the parameter search space. This work investigates 50 college students’ parameter search behaviors in the context of ecological modeling. The study revealed important differences in behaviors of successful and unsuccessful students in navigating the parameter space. These differences suggest opportunities for future development of adaptive cognitive scaffolds to support different classes of learners
more »
« less
Cognitive Strategies for Parameter Estimation in Model Exploration
Virtual laboratories that enable novice scientists to construct, evaluate and revise models of complex systems heavily involve parameter estimation tasks. We seek to understand novice strategies for parameter estimation in model exploration to design better cognitive supports for them. We conducted a study of 50 college students for a parameter estimation task in exploring an ecological model. We identified three types of behavioral patterns and their underlying cognitive strategies. Specifically, the students used systematic search, problem decomposition and reduction, and global search followed by local search as their cognitive strategies
more »
« less
- Award ID(s):
- 1636848
- PAR ID:
- 10333008
- Date Published:
- Journal Name:
- Proceedings of the 43rd Annual Conference of the Cognitive Science Society
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Benjamin, Paaßen; Carrie, Demmans Epp (Ed.)Open-ended learning environments (OELEs) have become an important tool for promoting constructivist STEM learning. OELEs are known to promote student engagement and facilitate a deeper understanding of STEM topics. Despite their benefits, OELEs present significant challenges to novice learners who may lack the self-regulated learning (SRL) processes they need to become effective learners and problem solvers. Recent studies have revealed the importance of the relationship between students' affective states, cognitive processes, and performance in OELEs. Yet, the relations between students' use of cognitive processes and their corresponding affective states have not been studied in detail. In this paper, we investigate the relations between studentsż˝f affective states and the coherence in their cognitive strategies as they work on developing causal models of scientific processes in the XYZ OELE. Our analyses and results demonstrate that there are significant differences in the coherence of cognitive strategies used by high- and low-performing students. As a result, there are also significant differences in the affective states of the high- and low-performing students that are related to the coherence of their cognitive activities. This research contributes valuable empirical evidence on studentsż˝f cognitive-affective dynamics in OELEs, emphasizing the subtle ways in which students' understanding of their cognitive processes impacts their emotional reactions in learning environments.more » « less
-
Novice programmers often face challenges in designing computational artifacts and fixing code errors, which can lead to task abandonment and over-reliance on external support. While research has explored effective meta-cognitive strategies to scaffold novice programmers' learning, it is essential to first understand and assess students' conceptual, procedural, and strategic/conditional programming knowledge at scale. To address this issue, we propose a three-model framework that leverages Large Language Models (LLMs) to simulate, classify, and correct student responses to programming questions based on the SOLO Taxonomy. The SOLO Taxonomy provides a structured approach for categorizing student understanding into four levels: Pre-structural, Uni-structural, Multi-structural, and Relational. Our results showed that GPT-4o achieved high accuracy in generating and classifying responses for the Relational category, with moderate accuracy in the Uni-structural and Pre-structural categories, but struggled with the Multi-structural category. The model successfully corrected responses to the Relational level. Although further refinement is needed, these findings suggest that LLMs hold significant potential for supporting computer science education by assessing programming knowledge and guiding students toward deeper cognitive engagement.more » « less
-
Designers can benefit from inspirational stimuli when presented during the design process. Encountering external stimuli can also lead designers to negative design outcomes by limiting exploration of the design space and idea generation. Prior work has investigated how specific features of inspirational stimuli can be beneficial or harmful to designers. However, the processes designers use to search for and discover inspirational stimuli leading to these outcomes are less known. The objective of this work is thus to better understand how designers search for inspirational design stimuli. Specifically, we investigate how factors such as designer expertise and search modality (e.g., text vs. visual-based) impact both explicit and implicit features during the search for design stimuli. A cognitive study was completed by novice and expert designers (seven students and eight professionals), who searched for design stimuli using a novel multi-modal search platform while following a think-aloud protocol. The multi-modal search platform enabled search using text and nontext inputs, and provided design stimuli in the form of 3D-model parts. This work presents methods to describe search processes in terms of three levels: activities, behaviors, and pathways, as defined in this paper. Our findings determine that design expertise and search modality influence search behavior. Illustrative examples are presented and discussed of search processes leading designers to both negative and beneficial outcomes, such as designers fixating on specific results or benefiting unexpectedly from unintentional inspirational stimuli. Overall, this work contributes to an improved understanding of how designers search for inspiration, and key factors influencing these behaviors.more » « less
-
Summary Randomized experiments have been the gold standard for drawing causal inference. The conventional model-based approach has been one of the most popular methods of analysing treatment effects from randomized experiments, which is often carried out through inference for certain model parameters. In this paper, we provide a systematic investigation of model-based analyses for treatment effects under the randomization-based inference framework. This framework does not impose any distributional assumptions on the outcomes, covariates and their dependence, and utilizes only randomization as the reasoned basis. We first derive the asymptotic theory for $ Z $-estimation in completely randomized experiments, and propose sandwich-type conservative covariance estimation. We then apply the developed theory to analyse both average and individual treatment effects in randomized experiments. For the average treatment effect, we consider model-based, model-imputed and model-assisted estimation strategies, where the first two strategies can be sensitive to model misspecification or require specific methods for parameter estimation. The model-assisted approach is robust to arbitrary model misspecification and always provides consistent average treatment effect estimation. We propose optimal ways to conduct model-assisted estimation using generally nonlinear least squares for parameter estimation. For the individual treatment effects, we propose directly modelling the relationship between individual effects and covariates, and discuss the model’s identifiability, inference and interpretation allowing for model misspecification.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
