An official website of the United States government
Today, there is a growing demand for housing complexes due to rapid urbanization in major metropolitan areas. While architects must meet new sustainability standards, they are also expected to demonstrate creative solutions for humanizing mass housing for the well-being of residents. This paper proposes an intuitive platform for users to visually study possible housing complex designs and their potential performance in energy use intensity (EUI), environmental, and some financial criteria based on preliminary sketches drawn by users. Before users start sketching, our program auto-generates basic layouts with performance results. With this knowledge, users will be able to visually grasp intrinsic relationships between built forms and performance characteristics and reflect on their new design. Our goal is to provide a platform that enables designers to effectively incorporate qualitative contributions from early exploratory stages into advanced design stages, allowing architects to focus on more creative solutions.
more »
« less
TunePad Playbooks: Designing Computational Notebooks for Creative Music Coding
This paper describes the design of an online learning platform that empowers musical creation and performance with Python code. For this platform we have developed an innovative computational note- book paradigm that we call TunePad playbooks. While playbooks borrow ideas from popular computational notebooks like Jupyter, we have designed them from the ground up to support creative mu- sical expression including live performances. After discussing our design principles and features, we share findings from a series of artifact-centered interviews conducted with experienced TunePad users. Our results show how systems like ours might flexibly sup- port a variety of creative workflows, while suggesting opportunities for future work in this area.
more »
« less
- PAR ID:
- 10343044
- Date Published:
- Journal Name:
- ACM Conference on Human Factors in Computing Systems (CHI'22)
- Page Range / eLocation ID:
- 1 to 12
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Creative iterative development over the past several years has generated an extensive set of computational tools, learning resources, and materials in the realm of paper mechatronics - an educational craft and design approach that weaves computational and mechanical elements into established traditions of children's construction with paper. Here, we both reflect upon our past and recent work of paper mechatronics, then look to the near- to medium-term future to speculate upon both the emerging trends in technology design and expanding learning potential of this medium for children along material, spatial, and temporal dimensions. We summarize lessons learned through various children's workshops with our materials; and we use these lessons as a foundation upon which to create a wide variety of novel tools and activities in educational papercrafting. We speculate upon the frontiers of this work based on current convergences and shifts in tangible creative computational media.more » « less
-
null (Ed.)Research in creative robotics continues to expand across all creative domains, including art, music and language. Creative robots are primarily designed to be task specific, with limited research into the implications of their design outside their core task. In the case of a musical robot, this includes when a human sees and interacts with the robot before and after the performance, as well as in between pieces. These non-musical interaction tasks such as the presence of a robot during musical equipment set up, play a key role in the human perception of the robot however have received only limited attention. In this paper, we describe a new audio system using emotional musical prosody, designed to match the creative process of a musical robot for use before, between and after musical performances. Our generation system relies on the creation of a custom dataset for musical prosody. This system is designed foremost to operate in real time and allow rapid generation and dialogue exchange between human and robot. For this reason, the system combines symbolic deep learning through a Conditional Convolution Variational Auto-encoder, with an emotion-tagged audio sampler. We then compare this to a SOTA text-to-speech system in our robotic platform, Shimon the marimba player.We conducted a between-groups study with 100 participants watching a musician interact for 30 s with Shimon. We were able to increase user ratings for the key creativity metrics; novelty and coherence, while maintaining ratings for expressivity across each implementation. Our results also indicated that by communicating in a form that relates to the robot’s core functionality, we can raise likeability and perceived intelligence, while not altering animacy or anthropomorphism. These findings indicate the variation that can occur in the perception of a robot based on interactions surrounding a performance, such as initial meetings and spaces between pieces, in addition to the core creative algorithms.more » « less
-
While there is a growing body of research that explores the integration of music and coding in learning environments, much of this work has either emphasized the technical aspects of computer language design or music as a motivational context within which to learn computer science concepts. In this paper, we report on a study in which five undergraduate students with experience in both music and coding completed two creative musical tasks: one using conventional instruments and tools and one using Python code in an online music + coding environment. Inspired by the work of Christopher Small (1998. Musicking: The Meanings of Performing and Listening. University Press of New England), we describe music + coding as a set of interlocking processes which we call computational musicking and explore how practices from both domains are reimagined in this new hybrid context. We introduce semiotic theories of translation and transcription to make sense of the computational musicking process and describe strategies that participants devised in their creative process.more » « less
-
Physical computing enables learners to create interactive projects using tangible materials and electronic components. These projects commonly utilize microcontroller boards like the micro:bit. In contrast, computer vision (CV) is a powerful technique for detecting input through interaction with everyday materials like paper, and it can be utilized for physical computing projects. However, CV-based toolkits are typically limited to input detection and rely on screen-based or projected outputs. This paper presents a hybrid approach that integrates a CV-based platform called Paper Playground with the micro:bit electronics platform. By combining CV-detected, paper-based inputs with the rich input-output possibilities of microcontroller-based systems, we showcase a multimodal physical computing toolkit. Through three project examples, we explore how this hybrid approach can enhance the creative possibilities in physical computing, and develop a preliminary design space combining CV-based and electronics-based physical computing.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3491102.3502021
