Researchers, educators, and multimedia designers need to better understand how mixing physical tangible objects with virtual experiences affects learning and science identity. In this novel study, a 3D-printed tangible that is an accurate facsimile of the sort of expensive glassware that chemists use in real laboratories is tethered to a laptop with a digitized lesson. Interactive educational content is increasingly being placed online, it is important to understand the educational boundary conditions associated with passive haptics and 3D-printed manipulables. Cost-effective printed objects would be particularly welcome in rural and low Socio-Economic (SES) classrooms. A Mixed Reality (MR) experience was created that used a physical 3D-printed haptic burette to control a computer-based chemistry titration experiment. This randomized control trial study with 136 college students had two conditions: 1) low-embodied control (using keyboard arrows), and 2) high-embodied experimental (physically turning a valve/stopcock on the 3D-printed burette). Although both groups displayed similar significant gains on the declarative knowledge test, deeper analyses revealed nuanced Aptitude by Treatment Interactions (ATIs). These interactionsfavored the high-embodied experimental group that used the MR devicefor both titration-specific posttest knowledge questions and for science efficacy and science identity. Those students with higher prior science knowledge displayed higher titration knowledge scores after using the experimental 3D-printed haptic device. A multi-modal linguistic and gesture analysis revealed that during recall the experimental participants used the stopcock-turning gesture significantly more often, and their recalls created a significantly different Epistemic Network Analysis (ENA). ENA is a type of 2D projection of the recall data, stronger connections were seen in the high embodied group mainly centering on the key hand-turning gesture. Instructors and designers should consider the multi-modal and multi-dimensional nature of the user interface, and how the addition of another sensory-based learning signal (haptics) might differentially affect lower prior knowledge students. One hypothesis is that haptically manipulating novel devices during learning may create more cognitive load. For low prior knowledge students, it may be advantageous for them to begin learning content on a more ubiquitous interface (e.g., keyboard) before moving them to more novel, multi-modal MR devices/interfaces.
more »
« less
HandsOn: enabling embodied, creative STEM e-learning with programming-free force feedback
Embodied, physical interaction can improve learning by making abstractions concrete, while online courses and interactive lesson plans have increased education access and versatility. Haptic technology could integrate these benefits, but requires both low-cost hardware (recently enabled by low-cost DIY devices) and accessible software that enables students to creatively explore haptic environments without writing code. To investigate haptic e-learning without user programming, we developed HandsOn, a conceptual model for exploratory, embodied STEM education software; and implemented it with the SpringSim interface and a task battery for high school students. In two studies, we confirm that low-cost devices can render haptics adequately for this purpose, find qualitative impact of SpringSim on student strategies and curiosity, and identify directions for tool improvement and extension.
more »
« less
- Award ID(s):
- 1441358
- PAR ID:
- 10043051
- Date Published:
- Journal Name:
- Eurohaptics / Lecture Notes in Computer Science
- Volume:
- 9775
- Page Range / eLocation ID:
- 427-437
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Haptic technology has the potential to expand and transform the ways that students can experience a variety of science, technology, engineering, and math (STEM) topics. Designing kinesthetic haptic devices for educational applications is challenging because of the competing objectives of using low-cost components, making the device robust enough to be handled by students, and the desire to render high fidelity haptic virtual environments. In this paper, we present the evolution of a device called "Hapkit": a low cost, one-degree-of-freedom haptic kit that can be assembled by students. From 2013-2015, different versions of Hapkit were used in courses as a tool to teach haptics, physics, and control. These include a Massive Open Online Course (MOOC), two undergraduate courses, a graduate course, and a middle school class. Based on our experience using Hapkit in these educational environments, we evolved the design in terms of its structural materials, drive mechanism, and mechatronic components. Our latest design, Hapkit 3.0, includes several features that allow students to manufacture and assemble a robust and high-fidelity haptic device. First, it uses 3-D printed plastic structural material, which allows the design to be built and customized using readily available tools. Second, the design takes into account the limitations of 3-D printing, such as warping during printing and poor tolerances. This is achieved at a materials cost of approximately US $50, which makes it feasible for distribution in classroom and online education settings. The open source design is available at http://hapkit.stanford.edu.more » « less
-
Haptic force feedback systems are unique in their ability to dynamically render physical representations. Although haptic devices have shown promise for supporting learning, prior work mainly describes results of haptic-supported learning without identifying underlying learning mechanisms. To this end, we designed a haptic-supported learning environment and analyzed four students who used it to make connections between two different mathematical representations of sine and cosine: the unit circle, and their graph on the Cartesian plane. We highlight moments where students made connections between the representations, and identify how the haptic feedback supported these moments of insight. We use this evidence in support of a proposed theoretical and design framework for educational haptics. This framework captures four types of haptic representations, and focuses on one -- the haptic bridge -- that effectively scaffolds sense-making with multiple representations.more » « less
-
Wearables are becoming increasingly useful, primarily due to their activity-monitoring features that enable various healthcare applications. Everyday devices like smartwatches, however, often have complex ecosystems and convoluted interfaces. These devices need constant charging and can be difficult to use, cumbersome for users interested in only simple applications. As an alternative, simpler everyday wearable, we present Hapt-Aids, self-powered on-body tags that passively monitor user activities and deliver haptic notifications. Our small-footprint devices 1) harvest energy from activity-specific sources, 2) use this energy as sensor information, and 3) convert this energy into haptic actuation using only analog hardware, without digital components or firmware. This structurally simple, triple-purpose design makes our system extremely low maintenance while being cost- and energy-efficient, leading to a friendly user experience. We present our proof-of-concept system design: a custom, unique architecture formed through theoretical modeling and evaluation studies, and we build four demo applications. Through in-lab benchmark testing and user studies, we demonstrate the potential of Hapt-Aids as alternative low-cost, easy-to-use wearables.more » « less
-
Abstract: In science education, gestures have emerged as a valuable tool for both students to represent their reasoning and educators to assess learners’ developing knowledge. One reason is that gestures afford representing dynamic causal reasoning, a fundamental aspect of understanding various natural phenomena. However, gestures inherently lack feedback mechanisms and are possibly epiphenomenal to learning. We address these limitations by pairing haptic physical models with a computational NetLogo simulation designed to support students in comprehending dynamic interactions within complex systems. In this study, we investigated the impact of haptic learning experiences and computational environments on student-generated gestures. Our findings revealed that haptic learning experiences augment the computational environments by providing students with sensory feedback. This, in turn, leads to a shift in students' gestures, as they transition from representing aggregate patterns, such as quantity and motion, to individual interactions between physical entities and forces.more » « less
An official website of the United States government

