skip to main content

Attention:

The NSF Public Access Repository (PAR) system and access will be unavailable from 11:00 PM ET on Friday, December 13 until 2:00 AM ET on Saturday, December 14 due to maintenance. We apologize for the inconvenience.


Title: Pedagogical Strategies for Reflection in Project-based HCI Education with End Users
As HCI pedagogy research grows, so too does an emerging set of evidence-based teaching and curricular recommendations. Yet, few studies have implemented and examined these recommendations in the classroom. In this paper, we present a Research Through Design investigation of a studio-based HCI course, which was revised based on HCI education literature. Drawing on reflection surveys, video recordings of student-led user sessions, final project artifacts, and student interviews, we explore how students responded to key educational changes, the strategies that supported and hindered their reflective practices, and how reflection afforded new student insights. Our findings highlight the utility of video-based reflection exercises to support student learning in designing and running user sessions, the importance of multi-faceted reflection prompts, and how students noticed moments of inclusion and exclusion by attending to users’ non-verbal cues. Additionally, we empirically demonstrate the importance of implementing and studying HCI education research recommendations in the classroom.  more » « less
Award ID(s):
1834629
PAR ID:
10353933
Author(s) / Creator(s):
; ; ; ; ; ;
Date Published:
Journal Name:
Designing Interactive Systems Conference 2021 (DIS '21)
Page Range / eLocation ID:
1846 to 1860
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Viberg, O. ; Jivet, I. ; Muñoz-Merino, P. ; Perifanou, M. ; Papathoma, T. (Ed.)
    Past research shows that teachers benefit immensely from reflecting on their classroom practices. At the same time, adaptive and artificially intelligent (AI) tutors are shown to be highly effective for students, especially when teachers are involved in supporting students’ learning. Yet, there is little research on how to support teachers to reflect on their practices around AI tutors. We posit that analytics built on multimodal data from the classroom (e.g., teacher position, student-AI interaction) would be beneficial in providing effective scaffolding and evidence for teachers’ collaborative reflection on human-AI hybrid teaching. To better understand the design opportunities and constraints of a future tool for teacher reflection, we conducted storyboarding sessions with seven in-service teachers. Our analysis revealed that certain modalities (e.g., position v. video) might be more beneficial and less constrained than others in identifying reflection-worthy moments and trends. We discuss teachers’ needs for reflection in classrooms with AI tutors and their boundaries in using multimodal analytics. 
    more » « less
  2. Interaction design is playing an increasingly prominent role in computing research, while professional user experience roles expand. These forces drive the demand for more de- sign instruction in HCI classrooms. In this paper, we distill the popular approaches to teaching design to undergraduate and graduate students of HCI. Through a review of existing research on design pedagogy, an international survey of 61 HCI educators, and an analysis of popular textbooks, we explore the prominent disciplinary perspectives that shape design education in the HCI classroom. We draw on our analyses to discuss the differences we see in forms of design taught, approaches to adapting design instruction in computing-based courses, and the tensions faced by instructors of these classes. We conclude by arguing for the importance of pedagogical research on design instruction as a vital and foundational area of inquiry in Interaction Design and HCI. 
    more » « less
  3. In college cybersecurity education, problem-based learning has been introduced to promote student agency in solving a complex problem. However, a dilemma of balancing the student agency persist and previous research has focused on students’ cognitive, metacognitive, and regulatory to enhance the efficacy of PBL. Given the importance of students’ self-awareness of their agency, this study suggests a concept of meta-agency as an essential learner characteristic that influences the effectiveness of student agency in PBL. Four dimensions of meta-agency, perceptions of productive struggle, expectation alignment between instructor and students, strategies for regulating agency, and familiarity with PBL tasks, were qualitatively explored with student interview data. Features of meta-agency and how students’ meta-agency level develop through cybersecurity PBL sessions were further investigated. 
    more » « less
  4. In this work, we propose a video-based transfer learning approach for predicting problem outcomes of students working with an intelligent tutoring system (ITS). By analyzing a student's face and gestures, our method predicts the outcome of a student answering a problem in an ITS from a video feed. Our work is motivated by the reasoning that the ability to predict such outcomes enables tutoring systems to adjust interventions, such as hints and encouragement, and to ultimately yield improved student learning. We collected a large labeled dataset of student interactions with an intelligent online math tutor consisting of 68 sessions, where 54 individual students solved 2,749 problems. We will release this dataset publicly upon publication of this paper. It will be available at https://www.cs.bu.edu/faculty/betke/research/learning/. Working with this dataset, our transfer-learning challenge was to design a representation in the source domain of pictures obtained “in the wild” for the task of facial expression analysis, and transferring this learned representation to the task of human behavior prediction in the domain of webcam videos of students in a classroom environment. We developed a novel facial affect representation and a user-personalized training scheme that unlocks the potential of this representation. We designed several variants of a recurrent neural network that models the temporal structure of video sequences of students solving math problems. Our final model, named ATL-BP for Affect Transfer Learning for Behavior Prediction, achieves a relative increase in mean F -score of 50 % over the state-of-the-art method on this new dataset. 
    more » « less
  5. In this Great Ideas for Teaching Students (GIFTS) paper, we offer learning outcomes that we are beginning to recognize from our eight-week research experience for undergraduates (REU). There are four characteristics that have been found to be essential to success in Science, Technology, Engineering, and Mathematics (STEM) fields: a strong sense of STEM identity, scientific self-efficacy, a sense of belonging, and a psychological sense of community. This is especially true for first-year and transfer students pursuing STEM undergraduate degrees. A variety of studies have been published that go into detail about why these characteristics in particular have such a significant effect on student performance and retention. This paper will present Critical Self-Reflection as a practical way to integrate development of these characteristics into student research experiences to foster experiential learning that goes beyond increasing technical skills. STEM students are not often trained to critically self-reflect on their experiences in classroom and research settings. An inability for undergraduates to reflect intentionally on their experiences creates greater risk for attrition from STEM disciplines. Curated reflective experiences in collaborative learning settings can offer professional development opportunities to enhance students’ social and technical communication skills. There are four phases within the scaffolded Critical Self-Reflection framework: Learning to Reflect, Reflection for Action, Reflection in Action, and Reflection on Action. When applying the evidence-based practice, STEM undergraduate researchers describe their perceptions via three activities: creating a legacy statement, participating in facilitated dialogue sessions, and writing curated reflection journal entries within an REU. Through critical self-reflection exercises, we are beginning to find growth of first-year and transfer STEM undergraduates in the following areas: understanding of their role in the lab; confidence in their researcher identity; expression of agency; observation and communication skills; and intentionality for action. Participating in this self-reflection allows students to make meaning of their experience enabling them to hone the aforementioned characteristics that creates a pathway from their undergraduate experience to undergraduate degree completion, graduate degree attainment, and to the STEM workforce. 
    more » « less