An official website of the United States government
Many institutions use undergraduate teaching assistants (tutors) in their computing courses to help provide more resources to students. Because of the role tutors play in students' learning experiences, recent work in computing education has begun to explore student-tutor interactions through the tutor's perspective and through direct observation of the interactions. The results suggest that these interactions are cognitively challenging for tutors and may not be as beneficial for students' learning as one might hope. Given that many of these interactions may be unproductive, this work seeks to understand how student expectations of these sessions might be impacting the interactions' effectiveness. We interviewed 15 students in a CS2 course to learn about the expectations and desires that students have when they attend tutoring sessions. Our findings indicate that there is variation in what students consider a desired result from the interaction, that assignment deadlines affect students' expectations and desires for interactions, and that students do not always want what they believe is beneficial for their learning. We discuss implications for instructors and potential guidance for students and tutors to make tutoring sessions more effective.
more »
« less
An Exploration of Student-Tutor Interactions in Computing
As enrollments in computing courses have surged, the ratio of students to faculty has risen at many institutions. Along with many other large undergraduate programs, our institution has adapted to this challenge by hiring increasing numbers of undergraduate tutors to help students. In early computing courses, their role at our institution is primarily to help students with their programming assignments. Despite our institution offering a training course for tutors, we are concerned about the quality and nature of these student-tutor interactions. As instruction moved online due to COVID-19, this provided the unique opportunity to record all student-tutor interactions (among consenting participants) for research. In order to gain an understanding of the behaviors common in these interactions, we conducted an initial qualitative analysis using open coding followed by a quantitative analysis on those codes. Overall, we found that students are not generally receiving the instruction we might hope or expect from these sessions. Notably, tutors often simply give students the solution to the problem in their code without teaching them about the process of finding and correcting their own errors. These findings highlight the importance of tutoring sessions for learning in introductory courses and motivate remediation to make these sessions more productive.
more »
« less
- PAR ID:
- 10428492
- Date Published:
- Journal Name:
- Proceedings of the 27th ACM Conference on on Innovation and Technology in Computer Science Education
- Volume:
- 1
- Page Range / eLocation ID:
- 435 to 441
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This paper examines the design and evaluation of Large Language Model (LLM) tutors for Python programming, focusing on personalization that accommodates diverse student backgrounds. It highlights the challenges faced by socioeconomically disadvantaged students in computing courses and proposes LLM tutors as a solution to provide inclusive educational support. The study explores two LLM tutors, Khanmigo and CS50.ai, assessing their ability to offer personalized learning experiences. By employing a focus group methodology at a public minority-serving institution, the research evaluates how these tutors meet varied educational goals and adapt to students’ diverse needs. The findings underscore the importance of advanced techniques to tailor interactions and integrate programming tools based on students' progress. This research contributes to the understanding of educational technologies in computing education and provides insights into the design and implementation of LLM tutors that effectively support equitable student success.more » « less
-
Selecting appropriate tutoring help actions that account for both a student’s content mastery and engagement level is essential for effective human tutors, indicating the critical need for these skills in autonomous tutors. In this work, we formulate the robot-student tutoring help action selection problem as the Assistive Tutor partially observable Markov decision process (AT-POMDP). We designed the AT-POMDP and derived its parameters based on data from a prior robot-student tutoring study. The policy that results from solving the ATPOMDP allows a robot tutor to decide upon the optimal tutoring help action to give a student, while maintaining a belief of the student’s mastery of the material and engagement with the task. This approach is validated through a between-subjects field study, which involved 4th grade students (n = 28) interacting with a social robot solving long division problems over five sessions. Students who received help from a robot using the AT-POMDP policy demonstrated significantly greater learning gains than students who received help from a robot with a fixed help action selection policy. Our results demonstrate that this robust computational framework can be used effectively to deliver diverse and personalized tutoring support over time for students.more » « less
-
In an earlier work, the authors compared the writing style of Mechanical Engineering Technology (MET) students in an “untutored” state to the writing style of “tutored” students, where the tutoring was provided by “generic” writing center tutors. The results of this study showed that aside from changes in the diction of the students’ work, there was little measurable improvement in the quality of student writing as measured by both the AAC&U VALUE Rubric and by the authors’ voice-development-style-diction method. The current work builds on the results of the previous work by providing training on a just-in-time basis for the writing center tutors. As with previous years, the students participating in the study were MET students in a last-semester capstone industrial design course. This course is organized around a series of open-ended industry-sponsored projects for which the students are expected to develop a solution to a mechanical engineering problem. The students work on the projects in teams of three or four students and complete the work over a two-semester sequence offered annually on a fall-spring basis. The assignment in the study was identical to that of previous years: an “analysis” report in which students are expected to apply content from previous courses to one aspect of the industry-sponsored design project. The present study will compare the results from three iterations of the study: the work of “untutored” students, i.e. those who did not received any writing center assistance whatsoever, those who tutored by “generic” writing center tutors, and lastly, the works of those tutored by tutors specifically trained in support of the specific intervention. In the two cases where tutor interaction occurred, it was required as a component of the course to ensure participation by the entire student cohort. In general, the interactions with the specially-trained tutors produced works with a more mature writing style on the part of the student as compared to those works produced by students who had interacted with the untrained tutors or no tutors at all. The work will also discuss survey data collected on the “generic” and specially-trained tutoring sessions and discuss the differences in the results. Preliminary results show that the specially-trained tutors reported pronounced levels of engagement in the tutoring session, as measured by student note-taking, student questions, student receptiveness to suggestions, and student desire to understand the reasoning behind the tutors’ suggestions. Specially-trained tutors also reported significantly higher levels of student interest suggestions about grammar, style, content, format, and citations. Overall, it is concluded that specific training for the tutors was most associated with increased levels of interaction between tutor and student. As the students in the final group (“trained tutors”) were told prior to the tutoring session that the tutors were “specially trained,” it remains to be determined if the increased interaction was due to better tutor preparation or a higher estimation of the value of the tutoring session on the part of the students receiving the tutoring. This is proposed as an extension to the current work.more » « less
-
In an earlier work, the authors compared the writing style of Mechanical Engineering Technology (MET) students in an “untutored” state to the writing style of “tutored” students, where the tutoring was provided by “generic” writing center tutors. The results of this study showed that aside from changes in the diction of the students’ work, there was little measurable improvement in the quality of student writing as measured by both the AAC&U VALUE Rubric and by the authors’ voice-development-style-diction method. The current work builds on the results of the previous work by providing training on a just-in-time basis for the writing center tutors. As with previous years, the students participating in the study were MET students in a last-semester capstone industrial design course. This course is organized around a series of open-ended industry-sponsored projects for which the students are expected to develop a solution to a mechanical engineering problem. The students work on the projects in teams of three or four students and complete the work over a two-semester sequence offered annually on a fall-spring basis. The assignment in the study was identical to that of previous years: an “analysis” report in which students are expected to apply content from previous courses to one aspect of the industry-sponsored design project. The present study will compare the results from three iterations of the study: the work of “untutored” students, i.e. those who did not received any writing center assistance whatsoever, those who tutored by “generic” writing center tutors, and lastly, the works of those tutored by tutors specifically trained in support of the specific intervention. In the two cases where tutor interaction occurred, it was required as a component of the course to ensure participation by the entire student cohort. In general, the interactions with the specially-trained tutors produced works with a more mature writing style on the part of the student as compared to those works produced by students who had interacted with the untrained tutors or no tutors at all. The work will also discuss survey data collected on the “generic” and specially-trained tutoring sessions and discuss the differences in the results. Preliminary results show that the specially-trained tutors reported pronounced levels of engagement in the tutoring session, as measured by student note-taking, student questions, student receptiveness to suggestions, and student desire to understand the reasoning behind the tutors’ suggestions. Specially-trained tutors also reported significantly higher levels of student interest suggestions about grammar, style, content, format, and citations. Overall, it is concluded that specific training for the tutors was most associated with increased levels of interaction between tutor and student. As the students in the final group (“trained tutors”) were told prior to the tutoring session that the tutors were “specially trained,” it remains to be determined if the increased interaction was due to better tutor preparation or a higher estimation of the value of the tutoring session on the part of the students receiving the tutoring. This is proposed as an extension to the current work.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3502718.3524786
