skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Haptic Experiences Shape Student-Generated Gestures While Learning with Computational Environments
Abstract: In science education, gestures have emerged as a valuable tool for both students to represent their reasoning and educators to assess learners’ developing knowledge. One reason is that gestures afford representing dynamic causal reasoning, a fundamental aspect of understanding various natural phenomena. However, gestures inherently lack feedback mechanisms and are possibly epiphenomenal to learning. We address these limitations by pairing haptic physical models with a computational NetLogo simulation designed to support students in comprehending dynamic interactions within complex systems. In this study, we investigated the impact of haptic learning experiences and computational environments on student-generated gestures. Our findings revealed that haptic learning experiences augment the computational environments by providing students with sensory feedback. This, in turn, leads to a shift in students' gestures, as they transition from representing aggregate patterns, such as quantity and motion, to individual interactions between physical entities and forces.  more » « less
Award ID(s):
2202468
PAR ID:
10537147
Author(s) / Creator(s):
; ;
Publisher / Repository:
ISLS
Date Published:
Page Range / eLocation ID:
218 to 225
Subject(s) / Keyword(s):
Gesture Haptics NetLogo
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; (, Journal of Chemical Education)
    Holme, Thomas A (Ed.)
    We previously observed students gesturing during a symmetry and group theory activity. This prompted additional interviews wherein we attempted to understand the semiotic function of these gestures. We report here on the gestures which students have used in this context to represent symmetry elements, symmetry operations, and other related ideas. In the process, we have developed a scheme to code gestures in a systematic way that enables qualitative analysis and may lend itself to quantitative methods. This analysis leads to two observables: physical forms and motions enacted while representing or thinking about symmetry. These gestures are metaphorical and allow us to infer cognitive notions underlying the gesture as part of the student’s reasoning, their communication, or both. Characterizing these gestures and associated notions offers the opportunity to add to our understanding of how gesture and other embodied representations can systematically support student learning in relation to spatial concepts and descriptions in chemistry. This characterization also has implications for instruction to support student learning about symmetry in inorganic chemistry. 
    more » « less
  2. ; ; ; ; ; (, Conference on Interaction Design and Children)
    Haptic force feedback systems are unique in their ability to dynamically render physical representations. Although haptic devices have shown promise for supporting learning, prior work mainly describes results of haptic-supported learning without identifying underlying learning mechanisms. To this end, we designed a haptic-supported learning environment and analyzed four students who used it to make connections between two different mathematical representations of sine and cosine: the unit circle, and their graph on the Cartesian plane. We highlight moments where students made connections between the representations, and identify how the haptic feedback supported these moments of insight. We use this evidence in support of a proposed theoretical and design framework for educational haptics. This framework captures four types of haptic representations, and focuses on one -- the haptic bridge -- that effectively scaffolds sense-making with multiple representations. 
    more » « less
  3. ; (, Computer Applications in Engineering Education)
    Iskander, Magdy F (Ed.)
    ABSTRACT Innovative technology helps students foster creative thinking and problem‐solving abilities by augmenting human sensing and enriching input and output information. New technology can incorporate haptic sensing features—a sensing modality for user operations. Learning with haptic sensing features promises new ways to master cognitive and motor skills and higher‐order cognitive reasoning tasks (e.g., decision‐making and problem‐solving). This study conceptualizes haptic technology within the human‐technology interaction (HTI) framework. It aims to investigate the components of haptic systems to define their impact on learning and facilitate understanding of haptic technology, including application development to ease entry barriers for educators. The research builds a haptic HTI framework based on a systematic literature review on haptic applications in engineering learning over the last two decades. The review utilizes the SALSA methodology to analyze relevant studies comprehensively. The framework outcome is a haptic HTI taxonomy to build visual representations of the explicit connection between the taxonomy components and practical educational applications (by means of heatmaps). The approach led to a robust conceptualization of HTI into a taxonomy—a structured framework encompassing categories for interaction modalities, immersive technologies, and learning methodologies in engineering education. The model assists in understanding how haptic feedback can be utilized in learning with technology experiences. Applying haptic technology in engineering education includes mastering fundamental science concepts and creating customized haptic prototypes for engineering processes. A growing trend focuses on wearable haptics, such as gloves and vests, which involve kinesthetic movement, fine motor skills, and spatial awareness—all fostering spatial and temporal cognitive abilities (the ability to effectively manage and comprehend significant amounts ofspatial(how design components or resources are related to one another in the 3D space) andtemporal(the logic in a process, such as the order, sequences, and hierarchies of the resources information). The haptic human‐technology interaction (H‐HTI) framework guides future research in developing cognitive reasoning through H‐HTI, unlocking new frontiers in engineering education. 
    more » « less
  4. ; ; ; ; (, Eurohaptics Conference)
    One of the current limitations in digital educational experiences is the lack of touch. Touch is a critical component in the learning process and in creating inclusive educational experiences for sensorially diverse learners. From haptic devices to tangible user interfaces (TUI), a growing body of research is investigating ways to bring touch back into the digital world, yet many focus on a specific dimension (e.g. haptic feedback or kinesthetic manipulation) of touch. Learning, however, is a multi-dimensional touch experience - it is about moving and being moved. This work presents the Action Quad - a novel haptic-TUI design for teaching geometry (specifically quadrilaterals). The Action Quad is a multi-point-of-contact, reconfigurable tool that synergizes the affordances of both kinesthetic interaction and haptic feedback into a single form factor. We present findings from an initial user study (N=11) investigating how sighted- hearing individuals approach, interact, and experience the Action Quad, and we present a case study with an individual with blindness. We share key takeaways from the design process and participant feedback on interactions with this novel haptic-TUI device, sharing design insights on an emerging area of research that could support a new class of educational learning tools rooted in touch. 
    more » « less
  5. ; ; ; ; ; ; ; ; ; (, Springer, Cham)
    Recent years have seen growing awareness of the potential digital storytelling brings to creating engaging K-12 learning experiences. By fostering students’ interdisciplinary knowledge and skills, digital storytelling holds great promise for realizing positive impacts on student learning in language arts as well as STEM subjects. In parallel, researchers and practitioners increasingly acknowledge the importance of computational thinking in supporting K-12 students’ problem solving across subjects and grade levels, including science and elementary school. Integrating the unique affordances of digital storytelling and computational thinking offers significant potential; however, careful attention must be given to ensure students and teachers are properly supported and not overwhelmed. In this paper, we present our work on a narrative-centered learning environment that engages upper elementary students (ages 9 to 11) in computational thinking and physical science through the creation of interactive science narratives. Leveraging log data from a pilot study with 28 students using the learning environment, we analyze the narrative programs students created across multiple dimensions to better understand the nature of the resulting narratives. Furthermore, we examine automating this analysis using artificial intelligence techniques to support real-time adaptive feedback. Results indicate that the learning environment enabled students to create interactive digital stories demonstrating their understanding of physical science, computational thinking, and narrative concepts, while the automated assessment techniques showed promise for enabling real-time feedback and support. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email