The recent public releases of AI tools such as ChatGPT have forced computer science educators to reconsider how they teach. These tools have demonstrated considerable ability to generate code and answer conceptual questions, rendering them incredibly useful for completing CS coursework. While overreliance on AI tools could hinder students’ learning, we believe they have the potential to be a helpful resource for both students and instructors alike. We propose a novel system for instructor-mediated GPT interaction in a class discussion board. By automatically generating draft responses to student forum posts, GPT can help Teaching Assistants (TAs) respond to student questions in a more timely manner, giving students an avenue to receive fast, quality feedback on their solutions without turning to ChatGPT directly. Additionally, since they are involved in the process, instructors can ensure that the information students receive is accurate, and can provide students with incremental hints that encourage them to engage critically with the material, rather than just copying an AI-generated snippet of code. We utilize Piazza—a popular educational forum where TAs help students via text exchanges—as a venue for GPT-assisted TA responses to student questions. These student questions are sent to GPT-4 alongside assignment instructions and a customizable prompt, both of which are stored in editable instructor-only Piazza posts. We demonstrate an initial implementation of this system, and provide examples of student questions that highlight its benefits. 
                        more » 
                        « less   
                    
                            
                            Enhancing active learning through collaboration between human teachers and generative AI
                        
                    
    
            To address the increasing demand for AI literacy, we introduced a novel active learning approach that leverages both teaching assistants (TAs) and generative AI to provide feedback during in-class exercises. This method was evaluated through two studies in separate Computer Science courses, focusing on the roles and impacts of TAs in this learning environment, as well as their collaboration with ChatGPT in enhancing student feedback. The studies revealed that TAs were effective in accurately determining students’ progress and struggles, particularly in areas such as “backtracking”, where students faced significant challenges. This intervention’s success was evident from high student engagement and satisfaction levels, as reported in an end-of-semester survey. Further findings highlighted that while TAs provided detailed technical assessments and identified conceptual gaps effectively, ChatGPT excelled in presenting clarifying examples and offering motivational support. Despite some TAs’ resistance to fully embracing the feedback guidelines-specifically their reluctance to provide encouragement-the collaborative feedback process between TAs and ChatGPT improved the quality of feedback in several aspects, including technical accuracy and clarity in explaining conceptual issues. These results suggest that integrating human and artificial intelligence in educational settings can significantly enhance traditional teaching methods, creating a more dynamic and responsive learning environment. Future research will aim to improve both the quality and efficiency of feedback, capitalizing on unique strengths of both human and AI to further advance educational practices in the field of computing. 
        more » 
        « less   
        
    
                            - Award ID(s):
- 1918751
- PAR ID:
- 10561157
- Publisher / Repository:
- Elsevier
- Date Published:
- Journal Name:
- Computers and Education Open
- Volume:
- 6
- Issue:
- C
- ISSN:
- 2666-5573
- Page Range / eLocation ID:
- 100183
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
- 
            
- 
            Cristea, Alexandra; Walker, Erin; Lu, Yu; Santos, Olga (Ed.)This project examines the prospect of using AI-generated feedback as suggestions to expedite and enhance human instructors’ feedback provision. In particular, we focus on understanding the teaching assistants’ perspectives on the quality of AI-generated feedback and how they may or may not utilize AI feedback in their own workflows. We situate our work in a foundational college Economics class, which has frequent short essay assignments. We developed an LLM-powered feedback engine that generates feedback on students’ essays based on grading rubrics used by the teaching assistants (TAs). To ensure that TAs can meaningfully critique and engage with the AI feedback, we had them complete their regular grading jobs. For a randomly selected set of essays that they had graded, we used our feedback engine to generate feedback and displayed the feedback as in-text comments in a Word document. We then performed think-aloud studies with 5 TAs over 20 1-hour sessions to have them evaluate the AI feedback, contrast the AI feedback with their handwritten feedback, and share how they envision using the AI feedback if they were offered as suggestions. The study highlights the importance of providing detailed rubrics for AI to generate high-quality feedback for knowledge-intensive essays. TAs considered that using AI feedback as suggestions during their grading could expedite grading, enhance consistency, and improve overall feedback quality. We discuss the importance of decomposing the feedback generation task into steps and presenting intermediate results, in order for TAs to use the AI feedback.more » « less
- 
            Cristea, Alexandra; Walker, Erin; Lu, Yu; Santos, Olga (Ed.)This project examines the prospect of using AI-generated feedback as suggestions to expedite and enhance human instructors’ feedback provision. In particular, we focus on understanding the teaching assistants’ perspectives on the quality of AI-generated feedback and how they may or may not utilize AI feedback in their own workflows. We situate our work in a foundational college Economics class, which has frequent short essay assignments. We developed an LLM-powered feedback engine that generates feedback on students’ essays based on grading rubrics used by the teaching assistants (TAs). To ensure that TAs can meaningfully critique and engage with the AI feedback, we had them complete their regular grading jobs. For a randomly selected set of essays that they had graded, we used our feedback engine to generate feedback and displayed the feedback as in-text comments in a Word document. We then performed think-aloud studies with 5 TAs over 20 1-hour sessions to have them evaluate the AI feedback, contrast the AI feedback with their handwritten feedback, and share how they envision using the AI feedback if they were offered as suggestions. The study highlights the importance of providing detailed rubrics for AI to generate high-quality feedback for knowledge-intensive essays. TAs considered that using AI feedback as suggestions during their grading could expedite grading, enhance consistency, and improve overall feedback quality. We discuss the importance of decomposing the feedback generation task into steps and presenting intermediate results, in order for TAs to use the AI feedback.more » « less
- 
            Artificial intelligence (AI) leverages mathematical algorithms to emulate human cognitive abilities, leading to a transformative impact on the education sector. Educators are at the front lines of implementing AI in the classroom. Recent scientific studies demonstrate the capacity of AI, particularly generative models like ChatGPT, to reshape various aspects of education. In a recent study, we showcased that the integration of both artificial intelligence, specifically ChatGPT, and interactive learning activities significantly enhances the engagement levels of STEM students enrolled in a General Biology course. Furthermore, this combined approach not only boosts student engagement but also demonstrates an improvement in their overall performance within the course. Building on preliminary studies, the objective of this review article is to delineate the diverse applications of generative AI in education. To achieve this objective, we conducted a thorough search across scientific databases, including Google Scholar, Science Direct, government websites, and other resources, to collect relevant papers. Our findings underscore the contributions of generative AI, exemplified by ChatGPT, in enabling students to generate innovative text for written assignments, providing personalized feedback, facilitating adaptive learning, enhancing accessibility to education by eliminating barriers for individuals with disabilities, and supporting research endeavors.more » « less
- 
            Artificial intelligence (AI) leverages mathematical algorithms to emulate human cognitive abilities, leading to a transformative impact on the education sector. Educators are at the front lines of implementing AI in the classroom. Recent scientific studies demonstrate the capacity of AI, particularly generative models like ChatGPT, to reshape various aspects of education. In a recent study, we showcased that the integration of both artificial intelligence, specifically ChatGPT, and interactive learning activities significantly enhances the engagement levels of STEM students enrolled in a General Biology course. Furthermore, this combined approach not only boosts student engagement but also demonstrates an improvement in their overall performance within the course. Building on preliminary studies, the objective of this review article is to delineate the diverse applications of generative AI in education. To achieve this objective, we conducted a thorough search across scientific databases, including Google Scholar, Science Direct, government websites, and other resources, to collect relevant papers. Our findings underscore the contributions of generative AI, exemplified by ChatGPT, in enabling students to generate innovative text for written assignments, providing personalized feedback, facilitating adaptive learning, enhancing accessibility to education by eliminating barriers for individuals with disabilities, and supporting research endeavors.more » « less
 An official website of the United States government
An official website of the United States government 
				
			 
					 
					
 
                                    