A key affordance of game-based learning environments is their potential to unobtrusively assess student learning without interfering with gameplay. In this paper, we introduce a temporal analytics framework for stealth assessment that analyzes students' problem-solving strategies. The strategy-based temporal analytic framework uses long short-term memory network-based evidence models and clusters sequences of students' problem-solving behaviors across consecutive tasks. We investigate this strategy based temporal analytics framework on a dataset of problem solving behaviors collected from student interactions with a game-based learning environment for middle school computational thinking. The results of an evaluation indicate that the strategy-based temporal analytics framework significantly outperforms competitive baseline models with respect to stealth assessment predictive accuracy.
more »
« less
Investigating the Impact of Backward Strategy Learning in a Logic Tutor: Aiding Subgoal Learning Towards Improved Problem Solving
Learning to derive subgoals reduces the gap between experts and students and prepares students for future problem solving. This paper explores a training strategy using backward worked examples (BWE) and backward problem solving (BPS) within an intelligent logic tutor to support backward strategy learning, with analysis of student experience, performance, and proof construction. Results show that students trained with both BWE and BPS outperform those receiving none or only BWE, demonstrating more efficient subgoal derivation.
more »
« less
- Award ID(s):
- 2013502
- PAR ID:
- 10609426
- Publisher / Repository:
- International Journal of Artificial Intelligence in Education / Springer
- Date Published:
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Lischka, A. E.; Dyer, E. B.; Jones, R. S.; Lovett, J. N.; Strayer, J.; Drown, S. (Ed.)Problem solving is a very important skill for students to learn (e.g., Bonilla-Rius, 2020; NGA, 2010), and part of developing problem solving skills is learning to persevere. One strategy for learning how to persevere is by providing students with materials that allow them the opportunity to engage with challenging problems (e.g., Kapur, 2010; Middleton et al., 2015). This study of the Volume unit of the AC2inG materials analyzes students’ strategies for problem solving and persevering. Findings from these think-aloud interviews indicate that different students will utilize one or more methods for solving challenging problems, such as asking clarifying questions, talking themselves through the problem, and attempting various mathematical approaches.more » « less
-
This study examined the relations among strategic planning, execution, and strategy efficiency during problem-solving in a digital algebra learning game with 7th-grade students. We used pre-solving pause time as a proxy indicator of strategic planning, and the productivity of the initial strategy as a measure of effective strategy execution. Additionally, we explored how these variables correlated with students’ posttest scores assessing algebraic knowledge. Mediation analyses at both the problem and student levels indicated that longer pre-solving pause times were associated with greater strategy efficiency. When considering both the direct and indirect effects of pre-solving pause time on strategy efficiency, the results revealed a partial positive mediation through the productivity of the initial strategy. Lastly, the results of a path analysis showed that strategy efficiency significantly predicted algebraic knowledge with a positive effect. These findings suggest that longer pause times are associated with more efficient problem solving as they increase the likelihood of a productive initial step, highlighting a positive mediating role of execution in the relation between planning and strategy efficiency in algebraic problem solving.more » « less
-
We present a study that examines the effects of guidance on learning about addressing ill-defined problems in undergraduate bi- ology education. Two groups of college students used an online labo- ratory named VERA to learn about ill-defined ecological phenomena. While one group received guidance, such as giving the learners a specific problem and instruction on problem-solving methods, the other group re- ceived minimal guidance. The results indicate that, while performance in a problem-solving task was not different between groups receiving more vs. minimal guidance, the group that received minimal guidance adopted a more exploratory strategy and generated more interesting models of the given phenomena in a problem-solving task.more » « less
-
The primary goal of the authentic learning approach is to engage and motivate students in learning real world problem solving. We report our experience in developing k-nearest neighbor (KNN) classification for anomaly user behavior detection, one of the authentic machine learning for cybersecurity (ML4Cybr) learning modules based on 10 cybersecurity (CybrS) cases with machine learning (ML) solutions. All portable labs are made available on Google CoLab. So students can access and practice these hands-on labs anywhere and anytime without software installation and configuration which will engage students in learning concepts immediately and getting more experience for hands-on problem solving skills.more » « less
An official website of the United States government

