The electronics-centered approach to physical computing presents challenges when designers build tangible interactive systems due to its inherent emphasis on circuitry and electronic components. To explore an alternative physical computing approach we have developed a computer vision (CV) based system that uses a webcam, computer, and printed fiducial markers to create functional tangible interfaces. Through a series of design studios, we probed how designers build tangible interfaces with this CV-driven approach. In this paper, we apply the annotated portfolio method to reflect on the fifteen outcomes from these studios. We observed that CV markers offer versatile materiality for tangible interactions, afford the use of democratic materials for interface construction, and engage designers in embodied debugging with their own vision as a proxy for CV. By sharing our insights, we inform other designers and educators who seek alternative ways to facilitate physical computing and tangible interaction design.
more »
« less
A Survey of Interface Representations in Visual Programming Language Environments for Children’s Physical Computing Kits
Physical computing toolkits for children expose young minds to the concepts of computing and electronics within a target activity. To this end, these kits usually make use of a custom Visual Programming Language (or VPL) environment that extends past the functionality of simply programming, often also incorporating representations of electronics aspects in the interface. These representations of the electronics function as a scaffold to help the child focus on programming, instead of having to handle both the programming and details of the electronics at the same time. This paper presents a review of existing physical computing toolkits, looking at the What, How, and Where of electronics representations in their VPL interfaces. We then discuss potential research directions for the design of VPL interfaces for physical computing toolkits for children.
more »
« less
- Award ID(s):
- 1934113
- NSF-PAR ID:
- 10313097
- Date Published:
- Journal Name:
- International Conference on Interaction Design and Children
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Multicellular systems, from bacterial biofilms to human organs, form interfaces (or boundaries) between different cell collectives to spatially organize versatile functions 1,2 . The evolution of sufficiently descriptive genetic toolkits probably triggered the explosion of complex multicellular life and patterning 3,4 . Synthetic biology aims to engineer multicellular systems for practical applications and to serve as a build-to-understand methodology for natural systems 5–8 . However, our ability to engineer multicellular interface patterns 2,9 is still very limited, as synthetic cell–cell adhesion toolkits and suitable patterning algorithms are underdeveloped 5,7,10–13 . Here we introduce a synthetic cell–cell adhesin logic with swarming bacteria and establish the precise engineering, predictive modelling and algorithmic programming of multicellular interface patterns. We demonstrate interface generation through a swarming adhesion mechanism, quantitative control over interface geometry and adhesion-mediated analogues of developmental organizers and morphogen fields. Using tiling and four-colour-mapping concepts, we identify algorithms for creating universal target patterns. This synthetic 4-bit adhesion logic advances practical applications such as human-readable molecular diagnostics, spatial fluid control on biological surfaces and programmable self-growing materials 5–8,14 . Notably, a minimal set of just four adhesins represents 4 bits of information that suffice to program universal tessellation patterns, implying a low critical threshold for the evolution and engineering of complex multicellular systems 3,5 .more » « less
-
Wearable construction toolkits have shown promise in broadening participation in computing and empowering users to create personally meaningful computational designs. However, these kits present a high barrier of entry for some users, particularly young children (K-6). In this paper, we introduce MakerWear, a new wearable construction kit for children that uses a tangible, modular approach to wearable creation. We describe our participatory design process, the iterative development of MakerWear, and results from single- and multi-session workshops with 32 children (ages 5-12; M=8.3 years). Our findings reveal how children engage in wearable design, what they make (and want to make), and what challenges they face. As a secondary analysis, we also explore age-related differences.more » « less
-
Gresalfi, M. ; Horn, I. (Ed.)Much attention has focused on student learning while making physical computational artifacts such as robots or electronic textiles, but little is known about how students engage with the hardware and software debugging issues that often arise. In order to better understand students’ debugging strategies and practices, we conducted and video-recorded eight think- aloud sessions (~45 minutes each) of high school student pairs debugging electronic textiles projects with researcher-designed programming and circuitry/crafting bugs. We analyzed each video to understand pairs’ debugging strategies and practices in navigating the multi- representational problem space. Our findings reveal the importance of employing system-level strategies while debugging physical computing systems, and of coordinating between various components of physical computing systems, for instance between the physical artifact, representations on paper, and the onscreen programming environment. We discuss the implications of our findings for future research and designing instruction and tools for learning with and debugging physical computing systems.more » « less
-
Many newcomers to programming and computational thinking have been brought up on interactive, gamified learning environments. Introductory computer science courses at the university level need to dig deeper into these topics, but must do so with similarly engaging technologies and projects. To address this need, we have built a framework for a grid-based game API with event-based blocking and continuous non-blocking interfaces. The framework abstracts away much of the complexity of inputs and rendering and exposes a simple game grid similar to a 2D array indexed by rows and columns. As such, our project helps reinforce basic computing concepts (arrays, loops, OOP, recursion) with a customizable and engaging game interface. We have discussed the valuable influence of visual representations of student's data structures using BRIDGES in previous publications, and believe our game API can provide significance and intrigue for students in introductory courses and beyond. Our Bridges Games App website (http://bridges-games.herokuapp.com/) presents descriptions and instructions.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3459990.3460727
