skip to main content


Title: TetRotation: Utilising Multimodal Analytics and Gestural Interaction to Nurture Mental Rotation Skills
Embodied Interaction (EI) offers unique opportunities to uncover novel ways to achieve experiential learning whilst keeping students stimulated and engaged. Spatial abilities have been repeatedly demonstrated as a success predictor for educations and professions in Science, Technology, Engineering and Mathematics. However, many researchers argue that training and assessment of this pertinent reasoning skill is vastly underrepresented in the school curriculum. This paper presents TetRotation, a PhD centred on how affordances coming from Multimodal Analytics can be coupled with EI to nurture Mental Rotation (MR) skills. The overarching objectives of the project are two fold. First, the TetRotation Interaction Design study will highlight best practices identified through the assessment of efficiency, level of engagement and learning gains achieved when using gesture based EI to solve MR tasks. Next, in the TetRotation Game study, these design practices will guide the implementation of an interactive serious game purposed to support the development of MR skills. This research relies on mixed method techniques, including data collections from users' actions, like motion sensing, EEG, gaze tracking, video-recordings, click streams, interviews and surveys.  more » « less
Award ID(s):
1919375
NSF-PAR ID:
10156503
Author(s) / Creator(s):
Date Published:
Journal Name:
Thirteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’19).
Page Range / eLocation ID:
715 to 718
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background. Middle school students’ math anxiety and low engagement have been major issues in math education. In order to reduce their anxiety and support their math learning, game-based learning (GBL) has been implemented. GBL research has underscored the role of social dynamics to facilitate a qualitative understanding of students’ knowledge. Whereas students’ peer interactions have been deemed a social dynamic, the relationships among peer interaction, task efficiency, and learning engagement were not well understood in previous empirical studies.

    Method. This mixed-method research implemented E-Rebuild, which is a 3D architecture game designed to promote students’ math problem-solving skills. We collected a total of 102 50-minutes gameplay sessions performed by 32 middle school students. Using video-captured and screen-recorded gameplaying sessions, we implemented behavior observations to measure students’ peer interaction efficiency, task efficiency, and learning engagement. We used association analyses, sequential analysis, and thematic analysis to explain how peer interaction promoted students’ task efficiency and learning engagement.

    Results. Students’ peer interactions were negatively related to task efficiency and learning engagement. There were also different gameplay patterns by students’ learning/task-relevant peer-interaction efficiency (PIE) level. Students in the low PIE group tended to progress through game tasks more efficiently than those in the high PIE group. The results of qualitative thematic analysis suggested that the students in the low PIE group showed more reflections on game-based mathematical problem solving, whereas those with high PIE experienced distractions during gameplay.

    Discussion. This study confirmed that students’ peer interactions without purposeful and knowledge-constructive collaborations led to their low task efficiency, as well as low learning engagement. The study finding shows further design implications: (1) providing in-game prompts to stimulate students’ math-related discussions and (2) developing collaboration contexts that legitimize students’ interpersonal knowledge exchanges with peers.

     
    more » « less
  2. This research work-in-progress paper investigated the application of emerging mixed reality (MR) technology in construction and engineering education. The construction industry is facing a severe shortage of skilled workforce. As the baby boomers are retiring, the younger generation, especially college students, are often criticized for their lack of professional experience and career-specific competency. To close the skills gap and accelerate the transition of college students to competent workforce, this paper proposed a new genre of learning and professional training using MR. The main promise of the MR technology resides in its ability to augment virtual contents on top of the physical reality to facilitate tacit knowledge learning, and simulate learning activities that traditionally can only be obtained from actual professional experience. An undergraduate wood framing lab was designed as a case study to explore how students might perform in this new learning and training environment. Specifically, the case study investigated if MR would facilitate student design comprehension and transfer such understanding into the knowledge and skills needed to build the wood structure. A randomly selected student control group was given traditional paper-based construction drawings to perform the same tasks with other student groups with various visualization technology assistance. Project performance and behavior of student groups were compared to determine if there was a significant difference between the control group and the experiment groups. A pair of pre- and post-survey on MR-intervened learning experience was also conducted to explore student perceptions towards this new genre of learning and training. The research design proposed in this work-in-progress study and its preliminary results could be a good reference and foundation to future research in this arena. 
    more » « less
  3. Abstract  
    more » « less
  4. To be successful in their future careers, students must be able to process information, devise creative solutions, and apply previous knowledge to new situations. Learning through only traditional teaching practices that rely heavily on lecture format and memorization is insufficient to prepare students for the future. Interactive project-based learning that experiences productive failure provides the opportunity for students to problem-solve novel topics and potentially fail at finding the solution. Through explanation, elaboration, comparison of iterations, refinement, and implementations, students can be more prepared to solve future problems. Our study examined the benefits of productive failure on high school students from both formal and informal learning environments working in collaborative teams to design and create 3D plant models. This STEAM project integrates science, design, and technology through innovative learning experiences in plant and agricultural science using emergent technologies. This learning experience encourages students to work together in collaborative teams of self-identified science, technophile, and art students to create 3D models of plants used in research at the Donald Danforth Plant Science Center in St. Louis, MO. Students learn about scientific research, the importance of plants in our society, and practice science communication skills. To create the 3D models, students must learn-by-doing to become proficient in using previously unfamiliar 3D modeling software where their teachers are merely facilitators. Students become active participants in their own learning by overcoming challenges through research, troubleshooting, teamwork, and perseverance. We used a mixed-method assessment approach comparing pre- and post-reflection questions. Students experience many challenges with learning the 3D model programs. They reported that they overcame difficulties working with the 3D modeling programs primarily through help from others and consulting outside resources, such as YouTube videos, as well as through continued effort. Students indicated that they faced challenges when creating their models but recognized that this project was a learning experience. Productive failure through the process of struggling and learning from one’s mistakes can encourage positive learning outcomes and give students a better ability to overcome future challenges. 
    more » « less
  5. Background: Project management and other professional skill training is often lacking in graduate student education, typically as a result of limited resources, lack of faculty buy-in, and narrow focus on thesis research. To address this need and with support from NSF, we are developing the Graduates for Advancing Professional Skills (GAPS) program at Iowa State University. To aid the initial development of this program, we conducted a literature review to understand the current context of the development and implementation of professional skills in higher education curricula, with specific interest in STEM fields. Purpose: The purpose of our study was to identify best practices related to implementing professional development skills into an academic curriculum. The goal was to utilize this information in the development, planning, implementation, and assessment of our GAPS program. Design: We engaged in a systematic literature review. We focused on the curricular and pedagogical approaches to implementing these skills, results of the initiatives, and methodologies used to assess their effectiveness. Results: Our literature review uncovered the “messiness” of teaching and learning of skills such as project management. There is often not one approach or definition of project management – it may change based on scope of project and context. Successful implementation requires adaptability, mentorship, problem solving, creativity, and communication. Additionally, project management has been referred to as a “threshold concept” and requires a certain level of intuition that cannot necessarily be gained through traditional classroom education. Conclusions: There appears to be an agreement on the importance of implementing project management skills at the postsecondary level. Our work illustrates the difficulty associated with undertaking this endeavor and provides guidance on approaches that can make these initiatives more beneficial. Although this literature was conducted to aid in the planning for our specific project, the synthesis of the extant works can inform other faculty and industry leaders who are interested in teaching and applying project management techniques in their courses or companies. 
    more » « less