An official website of the United States government
This Research Work In Progress Paper examines empirical evidence on the impacts of feedback from an intelligent tutoring software on sketching skill development. Sketching is a vital skill for engineering design, but sketching is only taught limitedly in engineering education. Teaching sketching usually involves one-on-one feedback which limits its application in large classrooms. To meet the demands of feedback for sketching instruction, SketchTivity was developed as an intelligent tutoring software. SketchTivity provides immediate personalized feedback on sketching freehand practice. The current study examines the effectiveness of the feedback of SketchTivity by comparing students practicing with the feedback and without. Students were evaluated on their motivation for practicing sketching, the development of their skills, and their perceptions of the software. This work in progress paper examines preliminary analysis in all three of these areas.
more »
« less
Assessing Common Errors Students Make When Negotiating
Intelligent tutoring systems have proven very effective at teaching hard skills such as math and science, but less research has examined how to teach “soft” skills such as negotiation. In this paper, we introduce an effective approach to teaching negotiation tactics. Prior work showed that students can improve through practice with intelligent negotiation agents. We extend this work by proposing general methods of assessment and feedback that could be applied to a variety of such agents. We evaluate these techniques through a human subject study. Our study demonstrates that personalized feedback improves students’ use of several foundational tactics.
more »
« less
- Award ID(s):
- 1822876
- PAR ID:
- 10119673
- Date Published:
- Journal Name:
- Artificial Intelligence in Education
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Large Language Models (LLMs) now excel at generative skills and can create content at impeccable speeds. However, they are imperfect and still make various mistakes. In a Computer Science education context, as these models are widely recognized as “AI pair programmers,” it becomes increasingly important to train students on evaluating and debugging the LLM-generated code. In this work, we introduce HypoCompass, a novel system to facilitate deliberate practice on debugging, where human novices play the role of Teaching Assistants and help LLM-powered teachable agents debug code. We enable effective task delegation between students and LLMs in this learning-by-teaching environment: students focus on hypothesizing the cause of code errors, while adjacent skills like code completion are offloaded to LLM-agents. Our evaluations demonstrate that HypoCompass generates high-quality training materials (e.g., bugs and fixes), outperforming human counterparts fourfold in efficiency, and significantly improves student performance on debugging by 12% in the pre-to-post test.more » « less
-
Development of effective communication skills in engineering students is critical, yet challenging. As engineering programs are technically rigorous, work-intensive, and challenged by their high enrollment numbers, methods to improve students’ writing skills must be costeffective and scalable. This paper describes pedagogical changes and shares course materials designed to integrate core concepts from writing studies into an advanced laboratory-based civil engineering course. We incorporate language units developed by the Civil Engineering Writing Project that provide strong connections to professional engineers’ writing. Specific concepts that guided the redesign are genre awareness and flexibility, process orientation to writing, and global, prioritized feedback. Several semesters into the iterative implementation of these changes, teaching assistants observe greater student engagement, without an increase in teaching workload.more » « less
-
Proficiency in Orientation and Mobility (O&M) is vital for people who are blind or visually impaired (BVI) to access physical environments and economic opportunities. While much engineering effort has focused on using technology to augment the practice of using a mobility cane, there is comparatively little work on using technology in service of teaching the use of the cane itself. We report a case study of a multi-year collaboration between assistive technology researchers and a certified O&M instructor at Perkins School for the Blind to utilize technology to create O&M teaching tools that use the concept of gamification to make such training more fun and effective. In this collaboration we adopted an action research approach, and through the application of action research HCI methods created several prototype systems for teaching O&M skills. These prototypes were refined to create the Cane Game: a system for teaching students cane sweeping technique using interactive music and sound. The Cane Game system can be constructed for less than $100 and is capable of being distributed at large-scale. A qualitative study of Perkins students' O&M educational trajectories while using the system illuminates the conditions in which this tool is effective as a teaching aid.more » « less
-
As demand for data scientists has increased to inform decision-making across multiple fields of societal importance, postsecondary institutions have expanded data science course offerings. Despite such growth, educators struggle to teach students all the skills central to data science. They focus on programming and statistical tools and lack time for mentoring students in data storytelling. This working paper reviewed literature and interviewed experts to model the domain knowledge of data storytelling to inform the design of intelligent technology to support data storytelling instruction at scale. The paper closes with a recommendation of two ways that artificial intelligence tools can support the development of students’ data storytelling knowledge and skills: "direct" feedback to students on routine data science tasks and "facilitated" summaries of students' data story progress to inform instructors' feedback. We intend to apply these insights to the design of intelligent coaching in an online platform to support the development of storytelling competency at scale.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
