skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Examining Student Testing and Debugging Within a Computational Systems Modeling Context
Abstract Interpreting and creating computational systems models is an important goal of science education. One aspect of computational systems modeling that is supported by modeling, systems thinking, and computational thinking literature is “testing, evaluating, and debugging models.” Through testing and debugging, students can identify aspects of their models that either do not match external data or conflict with their conceptual understandings of a phenomenon. This disconnect encourages students to make model revisions, which in turn deepens their conceptual understanding of a phenomenon. Given that many students find testing and debugging challenging, we set out to investigate the various testing and debugging behaviors and behavioral patterns that students use when building and revising computational system models in a supportive learning environment. We designed and implemented a 6-week unit where students constructed and revised a computational systems model of evaporative cooling using SageModeler software. Our results suggest that despite being in a common classroom, the three groups of students in this study all utilized different testing and debugging behavioral patterns. Group 1 focused on using external peer feedback to identify flaws in their model, group 2 used verbal and written discourse to critique their model’s structure and suggest structural changes, and group 3 relied on systemic analysis of model output to drive model revisions. These results suggest that multiple aspects of the learning environment are necessary to enable students to take these different approaches to testing and debugging.  more » « less
Award ID(s):
1842035
PAR ID:
10415086
Author(s) / Creator(s):
; ; ;
Publisher / Repository:
Springer Science + Business Media
Date Published:
Journal Name:
Journal of Science Education and Technology
Volume:
32
Issue:
4
ISSN:
1059-0145
Page Range / eLocation ID:
p. 607-628
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Chinn, C.; Tan, E.; Chan, C.; Kali, Y. (Ed.)
    We developed the Systems Thinking (ST) and Computational Thinking (CT) Identification Tool (ID Tool) to identify student involvement in ST and CT as they construct and revise computational models. Our ID Tool builds off the ST and CT Through Modeling Framework, emphasizing the synergistic relationship between ST and CT and demonstrating how both can be supported through computational modeling. This paper describes the process of designing and validating the ID Tool with special emphasis on the observable indicators of testing and debugging computational models. We collected 75 hours of students’ interactions with a computational modeling tool and analyzed them using the ID Tool to characterize students’ use of ST and CT when involved in modeling. The results suggest that the ID Tool has the potential to allow researchers and practitioners to identify student involvement in various aspects of ST and CT as they construct and revise computational models. 
    more » « less
  2. Computational thinking has widely been recognized as a crucial skill for engineers engaged in problem-solving. Multidisciplinary learning environments such as integrated STEM courses are powerful spaces where computational thinking skills can be cultivated. However, it is not clear the best ways to integrate computational thinking instruction or how students develop computational thinking in those spaces. Thus, we wonder: To what extent does engaging students in integrated engineering design and physics labs impact their development of computational thinking? We have incorporated engineering design within a traditional introductory calculus-based physics lab to promote students’ conceptual understanding of physics while fostering scientific inquiry, mathematical modeling, engineering design, and computational thinking. Using a generic qualitative research approach, we explored the development of computational thinking for six teams when completing an engineering design challenge to propose an algorithm to remotely control an autonomous guided vehicle throughout a warehouse. Across five consecutive lab sessions, teams represented their algorithms using a flowchart, completing four iterations of their initial flowchart. 24 flowcharts were open coded for evidence of four computational thinking facets: decomposition, abstraction, algorithms, and debugging. Our results suggest that students’ initial flowcharts focused on decomposing the problem and abstracting aspects that teams initially found to be more relevant. After each iteration, teams refined their flowcharts using pattern recognition, algorithm design, efficiency, and debugging. The teams would benefit from having more feedback about their understanding of the problem, the relevant physics concepts, and the logic and efficiency of the flowcharts 
    more » « less
  3. This paper discusses the potential of two computational modeling approaches in moving students from simple linear causal reasoning to applying more complex aspects of systems thinking (ST) in explanations of scientific phenomena. While linear causal reasoning can help students understand some natural phenomena, it may not be sufficient for understanding more complex issues such as global warming and pandemics, which involve feedback, cyclic patterns, and equilibrium. In contrast, ST has shown promise as an approach for making sense of complex problems. To facilitate ST, computational modeling tools have been developed, but it is not clear to what extent different approaches promote specific aspects of ST and whether scaffolding such thinking should start with supporting students first in linear causal reasoning before moving to more complex causal dimensions. This study compares two computational modeling approaches, static equilibrium and system dynamics modeling, and their potential to engage students in applying ST aspects in their explanations of the evaporative cooling phenomenon. To make such a comparison we analyzed 10th grade chemistry students’ explanations of the phenomenon as they constructed and used both modeling approaches. The findings suggest that using a system dynamics approach prompts more complex reasoning aligning with ST aspects. However, some students remain resistant to the application of ST and continue to favor linear causal explanations with both modeling approaches. This study provides evidence for the potential of using system dynamics models in applying ST. In addition, the results raise questions about whether linear causal reasoning may serve as a scaffold for engaging students in more sophisticated types of reasoning. 
    more » « less
  4. The introduction of computational modeling into science curricula has been shown to benefit students’ learning, however the synergistic learning processes that contribute to these benefits are not fully understood. We study students’ synergistic learning of physics and computational thinking (CT) through their actions and collaborative discourse as they develop computational models in a visual block-structured environment. We adopt a case study approach to analyze students synergistic learning processes related to stopping conditions, initialization, and debugging episodes. Our findings show a pattern of evolving sophistication in synergistic reasoning for model-building activities. 
    more » « less
  5. Gresalfi, M.; Horn, I. S. (Ed.)
    As human society advances, new scientific challenges are constantly emerging. The use of systems thinking (ST) and computational thinking (CT) can help elucidate these problems and bring us closer to a possible solution. The construction and use of models is one of the most widely used tools when trying to understand systems. In this paper, we examine four case studies of student pairs who were engaged in building and using system models in an NGSS-aligned project-based learning unit on chemical kinetics. Using a theoretical framework that describes how CT and ST practices are manifested in the modeling process we examine the progression of students’ models during their model revisions and explore strategies they employ to overcome modeling challenges they face. We discuss some suggestions to scaffold students’ progression in constructing computational system models and prepare teachers to support their students in engaging in CT and ST practices. 
    more » « less