Debugging is a cornerstone of programming and has been shown to be especially problematic for beginners. While there has been some work trying to understand the difficulties that beginners face with debugging, investigating common mistakes or specific error types they struggle with, there is little work that focuses on in-depth analysis of how novice programmers approach debugging, and how it changes over time. In this paper, we present MAADS (MixedMethods Approach for the Analysis of Debugging Sequences), a scalable and generalizable approach that combines quantitative and qualitative methods by using a state/action representation and visualization to gain knowledge about the debugging process through a step by step analysis. To demonstrate the utility of MAADS, we analyzed the debugging processes of middle school students who developed code within May’s Journey, a game designed to teach basic programming principles. The approach showed great utility in identifying differences in students’ debugging techniques and learning paths.
more »
« less
Teaching Explicit Programming Strategies to Adolescents
One way to teach programming problem solving is to teach explicit, step-by-step strategies. While prior work has shown these to be effective in controlled settings, there has been little work investigating their efficacy in classrooms. We conducted a 5-week case study with 17 students aged 15-18, investigating students' sentiments toward two strategies for debugging and code reuse, students' use of scaffolding to execute these strategies, and associations between students' strategy use and their success at independently writing programs in class. We found that while students reported the strategies to be valuable, many had trouble regulating their choice of strategies, defaulting to ineffective trial and error, even when they knew systematic strategies would be more effective. Students that embraced the debugging strategy completed more features in a game development project, but this association was mediated by other factors, such as reliance on help, strategy self-efficacy, and mastery of the programming language used in the class. These results suggest that teaching of strategies may require more explicit instruction on strategy selection and self-regulation.
more »
« less
- PAR ID:
- 10119844
- Date Published:
- Journal Name:
- Symposium on Computer Science Education
- Page Range / eLocation ID:
- 469 to 475
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This work-in-progress paper seeks to examine faculty choice of teaching strategies to improve students’ engineering self-efficacy [1], [2] (belief in one’s abilities to successfully accomplish tasks in engineering) as well as their reflections on the effectiveness of the teaching strategy. Increases in self-efficacy have been related to improved academic and career outcomes [3], especially for women in non-traditional fields such as engineering. The goal of the study is to determine simple yet effective strategies that can be implemented in engineering classrooms to improve self-efficacy. Seven engineering faculty members participated in a faculty learning community (FLC), a semester long program to learn about teaching strategies in each of the four areas of self-efficacy; mastery experiences (e.g., active learning, scaffolding), vicarious learning (e.g., guest lectures, peer mentors, group work), social persuasion (e.g., constructive feedback, positive self-talk), and emotional arousal (e.g., test anxiety, building rapport). The faculty then chose and implemented strategies in each of the four areas in one of their engineering courses. Monthly meetings of the FLC during implementation allowed faculty to share their experiences and suggestions for refinements in their teaching strategy. The paper examines the faculty member choice (why they chose to use particular strategies in their course) as well as their reflections on how well the strategy worked (impact on student learning vs ease of implementation). In addition, the paper examines in-class observations and student survey responses to determine if they felt a particular strategy was useful. The research seeks to identify strategies that faculty members chose and are viewed as effective by both the faculty and students. The presentation will seek additional feedback from the wider community on the effectiveness of teaching strategies to improve self-efficacy and future work will include the analysis of additional surveys that were administered to measure student self-efficacy with the goal of determining simple and effective strategies that can be implemented in engineering classrooms.more » « less
-
As part of an overall research program investigating the impact of changes in teaching strategies on students' engineering social cognitions (self-efficacy and outcome expectations), this paper investigates students' confidence in their ability to learn and their instructor's ability to teach across 6 engineering courses. A group of 6 faculty formed a learning community focused on improved teaching strategies for their classes. The faculty chose selected strategies and implemented them in their classes. Surveys asked students to rank their confidence level in "their ability to learn" the specific class material and the instructor's "ability to teach" the class material using a sliding bar scale from 0-100. Surveys were conducted before and after the improvements to the teaching strategies at both the beginning and end of the semesters. The results of the surveys are compared before and after the teaching improvements, beginning to end of semester, per course, online to in-person, and per gender. In summary, the study found that while there was no significant difference in the control group, a decrease in students’ confidence to learn and in their confidence in their instructors’ ability to teach was observed in the treatment group. This decrease was observed in specific courses that changed instructional modes due to Covid. Despite teaching improvements, students’ confidence decreased as they moved through the course material. Further research is needed to explore these findings and their implications for teaching strategies.more » « less
-
Although engineering is becoming increasingly important in K-12 education, previous research has demonstrated that, similar to the general population, K-12 teachers typically hold inaccurate perceptions of engineering, which affects their ability to provide students with relevant engineering experiences. Studies have shown that K-12 teachers often confuse the work of engineers with that of automotive mechanics or construction workers or assume that engineering is only for “super smart” students who are naturally gifted or who come from higher socioeconomic backgrounds. This indicates that many teachers do not understand the nature of engineering work and have stereotypical attitudes about who is qualified to be an engineer. These inaccurate perceptions of engineering among K-12 teachers may influence the way that teachers introduce engineering practices to their students and make connections between engineering and the other STEM disciplines. In addition, teacher self-efficacy has been shown to not only influence teachers’ willingness to engage with a particular topic, but also to have a significant influence on the motivation and achievement of their students. Research also indicates that high-efficacy teachers typically exert more effort and utilize more effective instructional strategies than low-efficacy teachers. The goal of this study was to examine the perceptions that pre-service K-12 teachers hold about engineers and engineering, and to further explore how those perceptions influence their self-efficacy with teaching engineering and beliefs about what skills and resources are necessary to teach engineering in a K-12 classroom. We first developed a survey instrument that included questions taken from two previously published instruments: the Design, Engineering, and Technology survey and the Teaching Engineering Self-Efficacy Scale for K-12 Teachers. Forty-two students enrolled in an undergraduate program at {Name Redacted} in which students simultaneously pursue a bachelor’s degree in a STEM field and K-12 teacher licensure completed the survey. Based on survey responses, six participants, representing a range of self-efficacy scores and majors, were selected to participate in interviews. In these interviews, participants were asked questions about their perceptions of engineers and were also asked to sort a list of characteristics based on whether they applied to engineers or not. Finally, interview participants were asked questions about their confidence in their ability to teach engineering and about what skills and/or resources they would require to be able to teach engineering in their future classrooms. The results of this study indicated that the participants’ perceptions of engineering and engineers did impact their self-efficacy with teaching engineering and their beliefs about how well engineering could be incorporated into other STEM subjects. A recurring theme among participants with low self-efficacy was a lack of exposure to engineering and inaccurate perceptions of the nature of engineering work. These pre-service teachers felt that they would not be able to teach engineering to K-12 students because they did not personally have much exposure to engineering or knowledge about engineering work. In future work, we will investigate how providing pre-service teachers with training in engineering education and exposure to engineers and engineering students impacts both their perceptions of engineering and self-efficacy with teaching engineering.more » « less
-
Self-efficacy, or the belief in one's ability to accomplish a task or achieve a goal, can significantly influence the effectiveness of various instructional methods to induce learning gains. The importance of self-efficacy is particularly pronounced in complex subjects like Computer Science, where students with high self-efficacy are more likely to feel confident in their ability to learn and succeed. Conversely, those with low self-efficacy may become discouraged and consider abandoning the field. The work presented here examines the relationship between self-efficacy and students learning computer programming concepts. For this purpose, we conducted a randomized control trial experiment with university-level students who were randomly assigned into two groups: a control group where participants read Java programs accompanied by explanatory texts (a passive strategy) and an experimental group where participants self-explain while interacting through dialogue with an intelligent tutoring system (an interactive strategy). We report here the findings of this experiment with a focus on self-efficacy, its relation to student learning gains (to evaluate the effectiveness, we measure pre/post-test), and other important factors such as prior knowledge or experimental condition/instructional strategies as well as interaction effectsmore » « less
An official website of the United States government

