Cognitive control and rule learning are two important mechanisms that explain how goals influence behavior and how knowledge is acquired. These mechanisms are studied heavily in cognitive science literature within highly controlled tasks to understand human cognition. Although they are closely linked to the student behaviors that are often studied within intelligent tutoring systems (ITS), their direct effects on learning have not been explored. Understanding these underlying cognitive mechanisms of beneficial and harmful student behaviors can provide deeper insight into detecting such behaviors and improve predictive models of student learning. In this paper, we present a thinkaloud study where we asked students to narrate their thought processes while solving probability problems in ASSISTments. Students are randomly assigned to one of two conditions that are designed to induce the two modes of cognitive control based on the Dual Mechanisms of Control framework. We also observe how the students go through the phases of rule learning as defined in a rule learning paradigm. We discuss the effects of these different mechanisms on learning, and how the information they provide can be used in student modeling.
more »
« less
Using Thinkalouds to Understand Rule Learning and Cognitive Control Mechanisms Within an Intelligent Tutoring System",
Cognitive control and rule learning are two important mechanisms that explain how goals influence behavior and how knowledge is acquired. These mechanisms are studied heavily in cognitive science literature within highly controlled tasks to understand human cognition. Although they are closely linked to the student behaviors that are often studied within intelligent tutoring systems (ITS), their direct effects on learning have not been explored. Understanding these underlying cognitive mechanisms of beneficial and harmful student behaviors can provide deeper insight into detecting such behaviors and improve predictive models of student learning. In this paper, we present a thinkaloud study where we asked students to narrate their thought processes while solving probability problems in ASSISTments. Students are randomly assigned to one of two conditions that are designed to induce the two modes of cognitive control based on the Dual Mechanisms of Control framework. We also observe how the students go through the phases of rule learning as defined in a rule learning paradigm. We discuss the effects of these different mechanisms on learning, and how the information they provide can be used in student modeling.
more »
« less
- Award ID(s):
- 1912474
- NSF-PAR ID:
- 10188414
- Date Published:
- Journal Name:
- International Conference of Artificial Intelligence in Education
- Page Range / eLocation ID:
- 500-511
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract While formative assessments (FAs) can facilitate learning within undergraduate STEM courses, their impact likely depends on many factors, including how instructors implement them, whether students buy-in to them, and how students utilize them. FAs have many different implementation characteristics, including what kinds of questions are asked, whether questions are asked before or after covering the material in class, how feedback is provided, how students are graded, and other logistical considerations. We conducted 38 semi-structured interviews with students from eight undergraduate biology courses to explore how various implementation characteristics of in-class and out-of-class FAs can influence student perceptions and behaviors. We also interviewed course instructors to provide context for understanding student experiences. Using thematic analysis, we outlined various FA implementation characteristics, characterized the range of FA utilization behaviors reported by students, and identified emergent themes regarding the impact of certain implementation characteristics on student buy-in and utilization. Furthermore, we found that implementation characteristics have combined effects on student engagement and that students will tolerate a degree of “acceptable discomfort” with implementation features that contradict their learning preferences. These results can aid instructor reflection and guide future research on the complex connections between activity implementation and student engagement within STEM disciplines.more » « less
-
The purpose of this research paper is to understand how diverse students are incorporated into the social structure of a large enrollment first-year engineering design course. Despite previous work demonstrating the benefits of diverse individuals in engineering, little work has examined how diverse students are incorporated into the social networks that exist within engineering classrooms. Social interactions are one of the most influential sources for integration into communities of practice. Through understanding how students interact and the structure of these interactions, we can elucidate how the engineering community includes members of underrepresented populations. Previous social network analysis (SNA) studies have scrutinized student classroom interactions. These studies typically attempt to link classroom interactions to academic outcomes (i.e., grades). In this study, we start to shift the focus away from connecting student interactions to academic outcomes and examine how the structure of student interactions can encourage an inclusive environment in a formal engineering environment. SNA data was collected via an online survey (n = 502, 74% response rate) one month into the semester at a Western land-grant institution. The survey asked first-year engineering students to indicate with whom they had interacted using a pre-populated list of the class roster and open-ended questions. The number of students that were mentioned by a participant (out-degree) is interpreted as a proxy of their sociableness. Whereas, the number of times a student was mentioned by others (in-degree) is interpreted as popularity. We posit that in an inclusive network structure the social behaviors (i.e., in and out-degree) will be independent of students’ demographic characteristics (e.g., race and gender). Nonparametric hypothesis testing (i.e., Kruskal-Wallis and Dunn’s test) was used to investigate the effects of gender and race on both in and out-degree. Results indicate that the social structure of the first-year engineering community is inclusive of both gender and race. Specifically, results indicated no significant differences for in-degree based on measures of race and gender, for students who provided race and gender information. Out-degree was not significantly different based on race. However, women did demonstrate significantly higher out-degree scores (i.e., greater sociableness) than their peers. Building on previous SNA literature, the increased connections expressed by women may lead to increased learning gains or performance within engineering. Results indicated that the social structure of this first-year engineering course, as indicated by in-degree and out-degree, is not significantly different for underrepresented groups. This result begins to illustrate a more complex story than the existing literature has documented of engineering as an unwelcoming environment for underrepresented students. Future work will explore how these structures do or do not persist over time and how individuals develop attitudes towards diverse individuals as a result of these interactions. We hope that the results of this work will provide practical ways to improve engineering climate for underrepresented students.more » « less
-
more » « less
Background/Context: Schools are increasingly using scripted curricula that limit teacher autonomy. These limitations are exacerbated when scripted curricula are enacted in fully standardized, asynchronous online course environments with no mechanisms for student–teacher communication.
Purpose: This study extends understanding of how teacher discretion, identity, and the relationship between those two components shape students’ educational experiences online.
Research Design: Within a sequential mixed method design, we identified spaces for teacher discretion using critical discourse analysis. By coding lesson transcripts, we developed a typology of common strategies: friendly, directive, personalized, and procedural. We used the resulting typology to run statistical models examining associations among teacher identity, discretionary acts, and student achievement. Lastly, we turned back to the qualitative data to confirm findings, test hypotheses, and provide nuance.
Findings: Teachers presenting as Black were significantly more likely to use a procedural approach and significantly less likely to use friendly strategies. Students scored higher on their end-of-lesson quiz when their teacher used personalized strategies, such as sharing relevant personal experiences, and scored lower when teachers used friendly or directive strategies.
Conclusions: Findings have implications for understanding and enacting equitable educational practices in asynchronous, scripted online environments. The isolation of discretionary acts feasible within the virtual learning environment studied contributes nuance to knowledge of the mechanisms through which teacher discretion might result in more favorable learning outcomes for students belonging to minoritized groups.
-
As evidence grows supporting the importance of non-cognitive factors in learning, computer-assisted learning platforms increasingly incorporate non-academic interventions to influence student learning and learning related-behaviors. Non-cognitive interventions often attempt to influence students’ mindset, motivation, or metacognitive reflection to impact learning behaviors and outcomes. In the current paper, we analyze data from five experiments, involving seven treatment conditions embedded in mastery-based learning activities hosted on a computer-assisted learning platform focused on middle school mathematics. Each treatment condition embodied a specific non-cognitive theoretical perspective. Over seven school years, 20,472 students participated in the experiments. We estimated the effects of each treatment condition on students’ response time, hint usage, likelihood of mastering knowledge components, learning efficiency, and post-tests performance. Our analyses reveal a mix of both positive and negative treatment effects on student learning behaviors and performance. Few interventions impacted learning as assessed by the post-tests. These findings highlight the difficulty in positively influencing student learning behaviors and outcomes using non-cognitive interventions.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
