skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Move or be moved: The design of a haptic-tangible manipulative for paired digital education interactives
One of the current limitations in digital educational experiences is the lack of touch. Touch is a critical component in the learning process and in creating inclusive educational experiences for sensorially diverse learners. From haptic devices to tangible user interfaces (TUI), a growing body of research is investigating ways to bring touch back into the digital world, yet many focus on a specific dimension (e.g. haptic feedback or kinesthetic manipulation) of touch. Learning, however, is a multi-dimensional touch experience - it is about moving and being moved. This work presents the Action Quad - a novel haptic-TUI design for teaching geometry (specifically quadrilaterals). The Action Quad is a multi-point-of-contact, reconfigurable tool that synergizes the affordances of both kinesthetic interaction and haptic feedback into a single form factor. We present findings from an initial user study (N=11) investigating how sighted- hearing individuals approach, interact, and experience the Action Quad, and we present a case study with an individual with blindness. We share key takeaways from the design process and participant feedback on interactions with this novel haptic-TUI device, sharing design insights on an emerging area of research that could support a new class of educational learning tools rooted in touch.  more » « less
Award ID(s):
2119303
PAR ID:
10535271
Author(s) / Creator(s):
; ; ; ;
Publisher / Repository:
Eurohaptics Conference
Date Published:
Edition / Version:
1
Page Range / eLocation ID:
1-15
Subject(s) / Keyword(s):
Haptics Tangible User Interfaces STEM Education Inclusive Design
Format(s):
Medium: X
Location:
https://eurohaptics.org/ehc2024/wp-content/uploads/sites/5/2024/06/1183-doc.pdf
Sponsoring Org:
National Science Foundation
More Like this
  1. This article presents the Smart Quad, a tangible user interface (TUI) designed to enhance quadrilateral learning by integrating physical and digital educational tools. Developed through an iterative, user-centered design process, the Smart Quad is a tangible device that pairs with the PhET SimulationQuadrilateralcreating a multimodal, inclusive learning environment for geometry. We conducted a pilot study with four users with blindness or low vision (BLV) and a formal user study in two settings: a classroom study with 15 students from grades 6 to 8 and individual sessions with five students with BLV from grades 7 to 9. Our findings demonstrate the efficacy of the Smart Quad in facilitating hands-on, interactive learning experiences, particularly for students with BLV, and highlight the potential for TUIs to bridge gaps in mathematics education by supporting diverse learning needs and preferences. The results suggest that TUIs like the Smart Quad can significantly improve engagement and understanding of geometric concepts, offering a promising direction for future educational tools. 
    more » « less
  2. Over the last decade, extensive growth in digital educational content has opened up new opportunities for teaching and learning. Despite such advancements, digital learning experiences often omit one ofour richest and earliest learning modalities - touch. This lack of haptic (touch) interaction creates a growing gap in supporting inclusive, embodied learning experiences digitally. Our research centers on the development ofinclusive learning tools that can flexibly adapt for use in different learning contexts to support learners with a wide range of needs, co-designed with students with disabilities. In this paper, we focus on the development of a tangible device for geometry learning - the Tangible Manipulative for Quadrilaterals (TMQ). We detail the design evolution of the TMQ and present two user studies investigating the affordances o ft h eI M and the user strategies employed when explored in isolation and in tandem with a two-dimensional touchscreen-based rendering ofa quadrilateral. Findings illustrate the affordances of the I M Oo v e r traditional, static media and its ability to serve as an inclusive geometry learning tool. 
    more » « less
  3. Touch is often omitted or viewed as unnecessary in digital learning. Lack of touch feedback limits the accessibility and multimodal capacity of digital educational content. Touchscreens with vibratory, haptic feedback are prevalent, yet this kind of feedback is often under-utilized. This work provides initial investigations into the design, development, and use of vibratory feedback within multimodal, interactive, educational simulations on touchscreen devices by learners with and without visual impairments. The objective of this work is to design and evaluate different haptic paradigms that could support interaction and learning in educational simulations. We investigated the implementation of four haptic paradigms in two physics simulations. Interviews were conducted with eight learners (five sighted learners; three learners with visual impairments) on one simulation and initial results are shared. We discuss the learner outcomes of each paradigm and how they impact design and development moving forward. 
    more » « less
  4. Robot teleoperation is an emerging field of study with wide applications in exploration, manufacturing, and healthcare, because it allows users to perform complex remote tasks while remaining distanced and safe. Haptic feedback offers an immersive user experience and expands the range of tasks that can be accomplished through teleoperation. In this paper, we present a novel wearable haptic feedback device for a teleoperation system that applies kinesthetic force feedback to the fingers of a user. The proposed device, called a ‘haptic muscle’, is a soft pneumatic actuator constructed from a fabric-silicone composite in a toroidal structure. We explore the requirements of the ideal haptic feedback mechanism, construct several haptic muscles using different materials, and experimentally determine their dynamic pressure response as well as sensitivity (their ability to communicate small changes in haptic feedback). Finally, we integrate the haptic muscles into a data glove and a teleoperation system and perform several user tests. Our results show that most users could detect detect force changes as low as 3% of the working range of the haptic muscles. We also find that the haptic feedback causes users to apply up to 52% less force on an object while handling soft and fragile objects with a teleoperation system. 
    more » « less
  5. A joint project of design-based educational researchers, mechatronic engineers, and digital accessibility experts has created a new genre of pedagogical technologies — hybrid material–digital multimodal artifacts for collaborative learning of sensorily diverse students in inclusive classrooms. Here we present the Quad, a manipulable quadrilateral hand-held object that is linked in real time to its digital screen-based simulation, whose own transformation, in turn, activates content-oriented voice description and output sonification. Pilot studies with blind and visually-impaired student-participants suggest the Quad’s potential in grounding geometric reasoning, insight, and generalization in exploratory haptic–proprioceptive investigation. In its conception and development, the Quad exemplifies the ethical, philosophical, and theoretical perspectives of its collaborating designers respecting all children’s universal right to access and participate in cultural practices, including techno–scientific activities. As researchers, we harness technological innovations to realize moral obligations and, through that, to promote the study of human perception, action, and cognition. We look forward to mutual growth of our research program along with parallel efforts advancing an Italian project to promote teachers’ pre-service training and professional development surrounding implications of the embodiment turn in the cognitive sciences for school-based instructional practice. 
    more » « less