An official website of the United States government
One of the current limitations in digital educational experiences is the lack of touch. Touch is a critical component in the learning process and in creating inclusive educational experiences for sensorially diverse learners. From haptic devices to tangible user interfaces (TUI), a growing body of research is investigating ways to bring touch back into the digital world, yet many focus on a specific dimension (e.g. haptic feedback or kinesthetic manipulation) of touch. Learning, however, is a multi-dimensional touch experience - it is about moving and being moved. This work presents the Action Quad - a novel haptic-TUI design for teaching geometry (specifically quadrilaterals). The Action Quad is a multi-point-of-contact, reconfigurable tool that synergizes the affordances of both kinesthetic interaction and haptic feedback into a single form factor. We present findings from an initial user study (N=11) investigating how sighted- hearing individuals approach, interact, and experience the Action Quad, and we present a case study with an individual with blindness. We share key takeaways from the design process and participant feedback on interactions with this novel haptic-TUI device, sharing design insights on an emerging area of research that could support a new class of educational learning tools rooted in touch.
more »
« less
This content will become publicly available on December 31, 2026
It’s Hip to Be Square: A Tangible User Interface for Quadrilateral Learning
This article presents the Smart Quad, a tangible user interface (TUI) designed to enhance quadrilateral learning by integrating physical and digital educational tools. Developed through an iterative, user-centered design process, the Smart Quad is a tangible device that pairs with the PhET SimulationQuadrilateralcreating a multimodal, inclusive learning environment for geometry. We conducted a pilot study with four users with blindness or low vision (BLV) and a formal user study in two settings: a classroom study with 15 students from grades 6 to 8 and individual sessions with five students with BLV from grades 7 to 9. Our findings demonstrate the efficacy of the Smart Quad in facilitating hands-on, interactive learning experiences, particularly for students with BLV, and highlight the potential for TUIs to bridge gaps in mathematics education by supporting diverse learning needs and preferences. The results suggest that TUIs like the Smart Quad can significantly improve engagement and understanding of geometric concepts, offering a promising direction for future educational tools.
more »
« less
- Award ID(s):
- 1845490
- PAR ID:
- 10655461
- Publisher / Repository:
- ACM
- Date Published:
- Journal Name:
- ACM Transactions on Accessible Computing
- Volume:
- 18
- Issue:
- 4
- ISSN:
- 1936-7228
- Page Range / eLocation ID:
- 1 to 23
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Over the last decade, extensive growth in digital educational content has opened up new opportunities for teaching and learning. Despite such advancements, digital learning experiences often omit one ofour richest and earliest learning modalities - touch. This lack of haptic (touch) interaction creates a growing gap in supporting inclusive, embodied learning experiences digitally. Our research centers on the development ofinclusive learning tools that can flexibly adapt for use in different learning contexts to support learners with a wide range of needs, co-designed with students with disabilities. In this paper, we focus on the development of a tangible device for geometry learning - the Tangible Manipulative for Quadrilaterals (TMQ). We detail the design evolution of the TMQ and present two user studies investigating the affordances o ft h eI M and the user strategies employed when explored in isolation and in tandem with a two-dimensional touchscreen-based rendering ofa quadrilateral. Findings illustrate the affordances of the I M Oo v e r traditional, static media and its ability to serve as an inclusive geometry learning tool.more » « less
-
A joint project of design-based educational researchers, mechatronic engineers, and digital accessibility experts has created a new genre of pedagogical technologies — hybrid material–digital multimodal artifacts for collaborative learning of sensorily diverse students in inclusive classrooms. Here we present the Quad, a manipulable quadrilateral hand-held object that is linked in real time to its digital screen-based simulation, whose own transformation, in turn, activates content-oriented voice description and output sonification. Pilot studies with blind and visually-impaired student-participants suggest the Quad’s potential in grounding geometric reasoning, insight, and generalization in exploratory haptic–proprioceptive investigation. In its conception and development, the Quad exemplifies the ethical, philosophical, and theoretical perspectives of its collaborating designers respecting all children’s universal right to access and participate in cultural practices, including techno–scientific activities. As researchers, we harness technological innovations to realize moral obligations and, through that, to promote the study of human perception, action, and cognition. We look forward to mutual growth of our research program along with parallel efforts advancing an Italian project to promote teachers’ pre-service training and professional development surrounding implications of the embodiment turn in the cognitive sciences for school-based instructional practice.more » « less
-
Researchers, educators, and multimedia designers need to better understand how mixing physical tangible objects with virtual experiences affects learning and science identity. In this novel study, a 3D-printed tangible that is an accurate facsimile of the sort of expensive glassware that chemists use in real laboratories is tethered to a laptop with a digitized lesson. Interactive educational content is increasingly being placed online, it is important to understand the educational boundary conditions associated with passive haptics and 3D-printed manipulables. Cost-effective printed objects would be particularly welcome in rural and low Socio-Economic (SES) classrooms. A Mixed Reality (MR) experience was created that used a physical 3D-printed haptic burette to control a computer-based chemistry titration experiment. This randomized control trial study with 136 college students had two conditions: 1) low-embodied control (using keyboard arrows), and 2) high-embodied experimental (physically turning a valve/stopcock on the 3D-printed burette). Although both groups displayed similar significant gains on the declarative knowledge test, deeper analyses revealed nuanced Aptitude by Treatment Interactions (ATIs). These interactionsfavored the high-embodied experimental group that used the MR devicefor both titration-specific posttest knowledge questions and for science efficacy and science identity. Those students with higher prior science knowledge displayed higher titration knowledge scores after using the experimental 3D-printed haptic device. A multi-modal linguistic and gesture analysis revealed that during recall the experimental participants used the stopcock-turning gesture significantly more often, and their recalls created a significantly different Epistemic Network Analysis (ENA). ENA is a type of 2D projection of the recall data, stronger connections were seen in the high embodied group mainly centering on the key hand-turning gesture. Instructors and designers should consider the multi-modal and multi-dimensional nature of the user interface, and how the addition of another sensory-based learning signal (haptics) might differentially affect lower prior knowledge students. One hypothesis is that haptically manipulating novel devices during learning may create more cognitive load. For low prior knowledge students, it may be advantageous for them to begin learning content on a more ubiquitous interface (e.g., keyboard) before moving them to more novel, multi-modal MR devices/interfaces.more » « less
-
Spatial ability is a well-known predictor of success in science, technology, engineering, and mathematics (STEM) fields. The purpose of this study was to investigate and understand the spatial strategies that were used by blind and low-vision (BLV) individuals as they solved problems on the tactile mental cutting test (TMCT), an instrument that was designed to measure the spatial ability of BLV audiences. The TMCT is an accessible adaptation of the older, 1938 version of the mental cutting test (MCT) that has been used extensively in spatial ability research. Additionally, this paper seeks to compare these strategies with existing strategies that have been investigated with sighted populations. The BLV community is underrepresented in engineering and in spatial ability research. By understanding how BLV students understand and solve spatial problems and concepts, educators can develop and enhance educational content that is relevant to this population. By incorporating perspectives from the BLV community and making STEM curricula accessible to this population, more BLV individuals may be encouraged to pursue STEM or engineering career pathways.more » « less
