Museums have embraced embodied interaction: its novelty generates buzz and excitement among their patrons, and it has enormous educational potential. Human-Data Interaction (HDI) is a class of embodied interactions that enables people to explore large sets of data using interactive visualizations that users control with gestures and body movements. In museums, however, HDI installations have no utility if visitors do not engage with them. In this paper, we present a quasi-experimental study that investigates how different ways of representing the user ("mode type") next-to a data visualization alters the way in which people engage with a HDI system. We consider four mode types: avatar, skeleton, camera overlay, and control. Our findings indicate that the mode type impacts the number of visitors that interact with the installation, the gestures that people do, and the amount of time that visitors spend observing the data on display and interacting with the system.
more »
« less
Design Strategies and Optimizations for Human-Data Interaction Systems in Museums
Embodied interaction is particularly useful in museums because it allows to leverage findings from embodied cognition to support the learning of STEM concepts and thinking skills. In this paper, we focus on Human-Data Interaction (HDI), a class of embodied interactions that investigates the design of interactive data visualizations that users control with gestures and body movements. We describe an HDI system that we iteratively designed, implemented, and observed at a science museum, and that allows visitors to explore large sets of data on two 3D globe maps. We present and discuss design strategies and optimization that we implemented to mitigate two sets of design challenges: (1) Dealing with display, interaction, and affordance blindness; and, (2) Supporting multiple functionalities and collaboration.
more »
« less
- Award ID(s):
- 1848898
- PAR ID:
- 10181491
- Date Published:
- Journal Name:
- 2020 IEEE 20th International Conference on Advanced Learning Technologies (ICALT)
- Page Range / eLocation ID:
- 246 to 248
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Large age differences and geographic distance between siblings can often hinder the development of close relationships, as they may have different social circles and schedules. Younger siblings may also have limited access to digital technology, which can further complicate communication and interaction between them. In this paper, we developed two technology probes, Haptic Bubble and Emoji Board. Both of these systems utilize embodied interaction, which has been shown to be an effective way to engage children in remote communication. Our work focused on three main goals through the development and preliminary study: the system design goal involved testing the feasibility of the embodied design approach, the empirical goal was to collect information on how siblings use embodied communication technology and the design goal was to inspire new kinds of technology to support large gap siblings’ needs.more » « less
-
Embodied, physical interaction can improve learning by making abstractions concrete, while online courses and interactive lesson plans have increased education access and versatility. Haptic technology could integrate these benefits, but requires both low-cost hardware (recently enabled by low-cost DIY devices) and accessible software that enables students to creatively explore haptic environments without writing code. To investigate haptic e-learning without user programming, we developed HandsOn, a conceptual model for exploratory, embodied STEM education software; and implemented it with the SpringSim interface and a task battery for high school students. In two studies, we confirm that low-cost devices can render haptics adequately for this purpose, find qualitative impact of SpringSim on student strategies and curiosity, and identify directions for tool improvement and extension.more » « less
-
Embodied learning represents a natural and immersive approach to education, where the physical engagement of learners plays a critical role in how they perceive and internalize concepts. This allows students to actively embody and explore knowledge through interaction with their environment, significantly enhancing retention and understanding of complex subjects. However, researchers face significant challenges in exploring children's learning in these physically interactive spaces, particularly due to the complexity of tracking multiple students' movements and dynamic interactions in real-time. To address these challenges, this paper introduces a Double Diamond design thinking process for developing an AI-enhanced timeline aimed at assisting researchers in visualizing and analyzing interactions within embodied learning environments. We outline key considerations, challenges, and lessons learned in this user-centered design process. Our goal is to create a timeline that employs state-of-the-art AI techniques to help researchers interpret complex datasets, such as children's movements, gaze directions, and affective states during learning activities, thereby simplifying their tasks and augmenting the process of interaction analysis.more » « less
-
Abstract Those working in Engineering for Global Development seek to improve the conditions in developing countries. A common metric for understanding the development state of a given country is the Human Development Index (HDI), which focuses on three dimensions: health, education, and income. An engineer’s expertise does not always align with any of those dimensions directly, while they still hope to perform impactful work for human development. To discover other areas of expertise that are highly associated with the HDI, correlations and variable selection were performed between all World Development Indicators and the HDI. The resultant associations are presented according to industry sector for a straightforward connection to engineering expertise. The associated areas of expertise can be used during opportunity development as surrogates for focusing on the HDI dimensions themselves. The data analysis shows that work related to “Trade, Transportation, and Utilities,” such as electricity distribution, and exports or imports, “Natural Resources and Mining,” such as energy resources, agriculture, or access to clean water, and “Manufacturing,” in general, are most commonly associated with improvements in the HDI in developing countries. Also, because the associations were discovered at country-level, they direct where geographically particular areas of expertise have been historically associated with improving HDI.more » « less
An official website of the United States government

