skip to main content


Title: Using a Visual-Based Coding Platform to Assess Computational Thinking Skills in Introductory Physics
Developing assessment tools for computational thinking (CT) in STEM education is a precursor for science teachers to effectively integrate intervention strategies for CT practices. One problem to assessing CT skills is students’ varying familiarity with different programming languages and platforms. A text-neutral, open-source platform called iFlow, is capable of addressing this issue. Specifically, this innovative technology has been adopted to elicit underrepresented undergraduate students’ debugging skills. We present how the visual-based coding platform can be applied to bypass programming language bias in assessing CT. In this preliminary study, we discuss design principles of a visual-based platform to effectively assess debugging practices – identification, isolation, and iteration – with the use of iFlow assignments. Our findings suggest how the ability of iFlow to test parts of a program independently, dataflow connectivity, and equity in removing biases from students’ various backgrounds are advantageous over text-based platforms.  more » « less
Award ID(s):
2107104
NSF-PAR ID:
10523435
Author(s) / Creator(s):
; ;
Editor(s):
Blikstein, P; Van_Aalst, J; Kizito, R; Brennan, K
Publisher / Repository:
ISLS Conference
Date Published:
Page Range / eLocation ID:
2189 to 2192
Format(s):
Medium: X
Location:
Montreal, Canada
Sponsoring Org:
National Science Foundation
More Like this
  1. A rubric is presented to assess debugging skills for students particularly in the natural sciences and engineering. The three categories that are assessed for the cognitive processes in debugging skills are identification, isolation, and iteration. These are defined, and the characteristics of each process are listed. We discuss the method used to develop this rubric that was based on intentional errors in a programming assignment given to students in an introductory physics course. The programming in this assignment was in Python and a visual-based programming platform, called iFlow. We believe that visual-based programming will help elicit weaknesses in debugging because it removes students' familiarity with particular programming languages. Our focus on debugging skills came from a survey of students to self-identify barriers in computational work in an introductory physics course that included engineering majors. This skill was the primary self-identified barrier along with abstraction skills, which will be the focus of another work. We also present the results of this survey. The Python assignment (ntext = 9) was used to create the rubric and the iFlow assignment (ngraphic = 11) was used to test the rubric. Scoring was based on a scale of six levels in each category. Although the sample size was too small to establish rigorous scoring reliability, we discussed how the two researchers attained agreement in scoring the assignments after iterative modifications of the rubric and rescoring. For the Python assignment, the average for identification was 2.75/5, for isolation 2.30/5, and for iteration 3.33/5. For the iFlow assignment, the average for identification was 2.63/5, for isolation 2.23/5, and for iterate 3.32/5. A consistent trend from these assignments showed that students' approach to debugging is mainly to identify and iterate without a full understanding of the error (i.e., isolation). The lack of a full understanding of the error implies that students are prone to repeat the error. Thus, the important outcome of debugging is to understand the source of error by systematically investigating different parts of the computational solution. Our preliminary results led to the hypothesis that students with weak debugging skills are mainly due the isolation process. This hypothesis will be tested in a future experiment. Results from such an experiment will be significant to those who are designing intervention strategies to integrate computational thinking in science and engineering curricula. 
    more » « less
  2. Focusing on computational thinking (CT) as the process to integrate computer science across subjects, and making as the activity to engage in this process, is a promising way to introduce students to computing. However, there is little guidance on what practices instructors should employ in maker activities to support CT skill/disposition development. This case study takes place in a makerspace program, using the cognitive apprenticeship conceptual framework as analytical framing to answer the question: Within makerspace activities what evidence exists regarding promising practices that support youth development of CT skills and dispositions? Findings inform our understanding of practices instructors can utilize in making activities to assist students in advancing their CT skills/dispositions: tinkering, embodiment, walkthroughs, drawing, and debugging. 
    more » « less
  3. Novice programming learners encounter programming errors on a regular basis. Resolving programming errors, which is also known as debugging, is not easy yet important to programming learning. Students with poor debugging ability hardly perform well on programming courses. A debugging learning trajectory which identifies learning goals, learning pathways, and instructional activities will benefit debugging learning activities development. This study aims to develop a debugging learning trajectory for text-based programming learners. This is accomplished through (1) analyzing programming errors in a logic programming learning environment and (2) examining existing literature on debugging analysis. 
    more » « less
  4. C2STEM is a web-based learning environment founded on a novel paradigm that combines block-structured, visual programming with the concept of domain specific modeling languages (DSMLs) to promote the synergistic learning of discipline-specific and computational thinking (CT) concepts and practices. Our design-based, collaborative learning environment aims to provide students in K-12 classrooms with immersive experiences in CT through computational modeling in realistic scenarios (e.g., building models of scientific phenomena). The goal is to increase student engagement and include inclusive opportunities for developing key computational skills needed for the 21st century workforce. Research implementations that include a semester-long high school physics classroom study have demonstrated the effectiveness of our approach in supporting synergistic learning of STEM and CS/CT concepts and practices, especially when compared to a traditional classroom approach. This technology demonstration will showcase our CS+X (X = physics, marine biology, or earth science) learning environment and associated curricula. Participants can engage in our design process and learn how to develop curricular modules that cover STEM and CS/CT concepts and practices. Our work is supported by an NSF STEM+C grant and involves a multi-institutional team comprising Vanderbilt University, SRI International, Looking Glass Ventures, Stanford University, Salem State University, and ETR. More information, including example computational modeling tasks, can be found at C2STEM.org. 
    more » « less
  5. This paper examines the growing field of computational thinking (CT) in education. A review of the relevant literature shows a diversity in definitions, interventions, assessments, and models. After synthesizing various approaches used to develop the construct in K-16 settings, we have created the following working definition of CT: The conceptual foundation required to solve problems effectively and efficiently (i.e., algorithmically, with or without the assistance of computers) with solutions that are reusable in different contexts. This definition highlights that CT is primarily a way of thinking and acting, which can be exhibited through the use particular skills, which then can become the basis for performance-based assessments of CT skills. Based on the literature, we categorized CT into six main facets: decomposition, abstraction, algorithm design, debugging, iteration, and generalization. This paper shows examples of CT definitions, interventions, assessments, and models across a variety of disciplines, with a call for more extensive research in this area. 
    more » « less