There have been many calls recently for computing for all across the nation. While there are many opportunities to study and use computing to advance the fields of computer science, software development, and information technology, computing is also needed in a wide range of other disciplines, including engineering. Most engineering programs require students take a course that teaches them introductory programming, which covers many of the same topics as an introductory course for computing majors (and at times may be the same course). However, statistics about the success of a course that is an introductory programming course are sobering; approximately half the students will fail, forcing them to either repeat the course or leave their chosen field of study if passing the course is required.
This NSF IUSE project incorporates instructional techniques identified through educational psychology research as effective ways to improve student learning and retention in introductory programming. The research team has developed worked examples of problems that incorporate subgoal labels, which are explanations that describe the function of steps in the problem solution to the learner and highlight the problem-solving process. Using subgoal labels within worked examples, which has been effective in other STEM fields, students are able to see an expert's problem solving process, which helps students learn to solving problems before they can solve problem themselves. Experts, including instructors, teaching introductory level courses are often unable to explain the process they use in problem solving at a level that learners can grasp because they have automated much of the problem-solving processes after many years of practice. This submission will present the results of the first part of development of subgoals and will explain how to integrate them into classroom lessons in introductory computing classes.
more »
« less
Investigating the Impact of Backward Strategy Learning in a Logic Tutor: Aiding Subgoal Learning Towards Improved Problem Solving
Learning to derive subgoals reduces the gap between experts and students and makes students prepared for future problem solving. Researchers have explored subgoal-labeled instructional materials in traditional problem solving and within tutoring systems to help novices learn to subgoal. However, only a little research is found on problem-solving strategies in relationship with subgoal learning. Also, these strategies are under-explored within computer-based tutors and learning environments. The backward problem-solving strategy is closely related to the process of subgoaling, where problem solving iteratively refines the goal into a new subgoal to reduce difficulty. In this paper, we explore a training strategy for backward strategy learning within an intelligent logic tutor that teaches logic-proof construction. The training session involved backward worked examples (BWE) and problem solving (BPS) to help students learn backward strategy towards improving their subgoaling and problem-solving skills. To evaluate the training strategy, we analyzed students’ 1) experience with and engagement in learning backward strategy, 2) performance and 3) proof construction approaches in new problems that they solved independently without tutor help after each level of training and in posttest. Our results showed that, when new problems were given to solve without any tutor help, students who were trained with both BWE and BPS outperformed students who received none of the treatment or only BWE during training. Additionally, students trained with both BWE and BPS derived subgoals during proof construction with significantly higher efficiency than the other two groups.
more » « less- NSF-PAR ID:
- 10443974
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- International Journal of Artificial Intelligence in Education
- ISSN:
- 1560-4292
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Free-body diagrams (FBDs) are diagrammatic representations of external forces and moments exerted on an object of interest for solving kinetics problems. Several studies have reported different ways of teaching FBDs in terms of pictorial representation of forces (e.g., placement of vectors or labeling). However, there is little research on practice strategies for helping students learn how to draw FBDs. Through the use of task analysis and a model of subgoal learning, we will develop task-analysis-guided deliberate practice to enhance learning. Task analysis is often used in instructional design to extract knowledge requirements for acquiring a skill. Skill acquisition is usually divided into three phases including declarative, knowledge compilation, and procedural. Task analysis in our study will identify relevant declarative and procedural knowledge related to drawing FBDs. The findings will be used to develop deliberate practice. Deliberate practice can help novices develop good representations of the knowledge needed to produce superior problem solving performance. This has been viewed as a gold standard for practice. Although deliberate practice is mainly studied among elite performers, the recent literature has revealed promising results for novices. Considering cognitive capacity limitations, we will apply cognitive load theory to develop deliberate practice to help students build declarative and procedural knowledge without exceeding their working memory limitations. A knowledge extraction expert will take an iterative approach to conduct task analyses with a subject matter expert (or experts)to distill knowledge to a level that is appropriate for students in the dynamics course. We will then integrate the task analysis results with instructional design strategies derived from cognitive load theory and the subgoal learning model to develop deliberate practice and assessment materials. Examples and assessment results will be provided to evaluate the effectiveness of the instructional design strategies as well as the challenges.more » « less
-
Free-body diagrams (FBDs) are diagrammatic representations of external forces and moments exerted on an object of interest for solving kinetics problems. Several studies have reported different ways of teaching FBDs in terms of pictorial representation of forces (e.g., placement of vectors or labeling). However, there is little research on practice strategies for helping students learn how to draw FBDs. Through the use of task analysis and a model of subgoal learning, we will develop task-analysis-guided deliberate practice to enhance learning. Task analysis is often used in instructional design to extract knowledge requirements for acquiring a skill. Skill acquisition is usually divided into three phases including declarative, knowledge compilation, and procedural. Task analysis in our study will identify relevant declarative and procedural knowledge related to drawing FBDs. The findings will be used to develop deliberate practice. Deliberate practice can help novices develop good representations of the knowledge needed to produce superior problem solving performance. This has been viewed as a gold standard for practice. Although deliberate practice is mainly studied among elite performers, the recent literature has revealed promising results for novices. Considering cognitive capacity limitations, we will apply cognitive load theory to develop deliberate practice to help students build declarative and procedural knowledge without exceeding their working memory limitations. A knowledge extraction expert will take an iterative approach to conduct task analyses with a subject matter expert (or experts)to distill knowledge to a level that is appropriate for students in the dynamics course. We will then integrate the task analysis results with instructional design strategies derived from cognitive load theory and the subgoal learning model to develop deliberate practice and assessment materials. Examples and assessment results will be provided to evaluate the effectiveness of the instructional design strategies as well as the challenges.more » « less
-
null (Ed.)The subgoal learning framework has improved performance for novice programmers in higher education, but it has only started to be applied and studied in K-12 (primary/secondary). Programming education in K-12 is growing, and many international initiatives are attempting to increase participation, including curricular initiatives like Computer Science Principles and non-profit organizations like Code.org. Given that subgoal learning is designed to help students with no prior knowledge, we designed and implemented subgoals in the introduction to programming unit in Code.org's Computer Science Principles course. The redesigned unit includes subgoal-oriented instruction and subgoal-themed pre-written comments that students could add to their programming activities. To evaluate efficacy, we compared behaviors and performance of students who received the redesigned subgoal unit to those receiving the original unit. We found that students who learned with subgoals performed better on problem-solving questions but not knowledge-based questions and wrote more in open-ended response questions, including a practice Performance Task for the AP exam. Moreover, at least one-third of subgoal students continued to use the subgoal comments after the subgoal-oriented instruction had been faded, suggesting that they found them useful. Survey data from the teachers suggested that students who struggled with the concepts found the subgoals most useful. Implications for future designs are discussed.more » « less
-
null (Ed.)Determining when and whether to provide personalized support is a well-known challenge called the assistance dilemma. A core problem in solving the assistance dilemma is the need to discover when students are unproductive so that the tutor can intervene. Such a task is particularly challenging for open-ended domains, even those that are well-structured with defined principles and goals. We present a set of datadriven methods to classify, predict, and prevent unproductive problem-solving steps in the well-structured open-ended domain of logic. This approach leverages and extends the Hint Factory, a set of methods that leverages prior student solution attempts to build data-driven intelligent tutors. We present a HelpNeed classification that uses prior student data to determine when students are likely to be unproductive and need help learning optimal problem-solving strategies. We present a controlled study to determine the impact of an Adaptive pedagogical policy that provides proactive hints at the start of each step based on the outcomes of our HelpNeed predictor: productive vs. unproductive. Our results show that the students in the Adaptive condition exhibited better training behaviors, with lower help avoidance, and higher help appropriateness (a higher chance of receiving help when it was likely to be needed), as measured using the HelpNeed classifier, when compared to the Control. Furthermore, the results show that the students who received Adaptive hints based on HelpNeed predictions during training significantly outperform their Control peers on the posttest, with the former producing shorter, more optimal solutions in less time. We conclude with suggestions on how these HelpNeed methods could be applied in other well-structured open-ended domains.more » « less
