An official website of the United States government
Documentary filmmaking is inherently subjective. The filmmaking team decides when to film, how to angle the camera, how to edit, and what narrative to put forward. At the same time, documentary filmmaking has a capacity for sharing people's experiences, expressing emotion, and foregrounding context through image, sound, and movement. In this paper, we discuss the tensions with using documentary filmmaking as a method for documentation as well as dissemination in design research. We present our approach to creating a series of 12 documentary shorts in the context of the Inner Ear project. The Inner Ear is a data physicalization project that invites participants to capture vibrations in their homes, which are then materialized as porcelain sculptures. We articulate the pressures and uncertainties of filming, and the responsibility of building narrative through editing. Finally, we discuss the generative but conflicting goals of combining research documentation with public dissemination via documentary filmmaking.
more »
« less
The Inner Ear: Capturing and Physicalizing Home Vibrations
We present the Inner Ear: a porcelain device that both captures and represents data. In particular, we focus on sensing vibrations—for their hidden yet omnipresent qualities in domestic environments. We designed the Inner Ear in response and in contrast to a growing collection of ‘always on and recording’ smart home devices. With the Inner Ear, we purposefully let participants choose when to capture vibrations and which capture should be physicalized. In this pictorial, we describe the design and fabrication process of the capturing device as well as the data physicalization workflow. We contribute insights on (1) the design rationale and development of a double function artifact (to both capture and represent), as well as (2) design decisions involved in balancing legibility with leaving room for meaning making during the transcription of home vibration data.
more »
« less
- Award ID(s):
- 1947696
- PAR ID:
- 10465943
- Date Published:
- Journal Name:
- DIS '23: Proceedings of the 2023 ACM Designing Interactive Systems Conference
- Page Range / eLocation ID:
- 594 to 607
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Teleost fishes have evolved a number of sound-producing mechanisms, including vibrations of the swim bladder. In addition to sound production, the swim bladder also aids in sound reception. While the production and reception of sound by the swim bladder has been described separately in fishes, the extent to which it operates for both in a single species is unknown. Here, using morphological, electrophysiological and modelling approaches, we show that the swim bladder of male plainfin midshipman fish (Porichthys notatus) exhibits reproductive state-dependent changes in morphology and function for sound production and reception. Non-reproductive males possess rostral ‘horn-like’ swim bladder extensions that enhance low-frequency (less than 800 Hz) sound pressure sensitivity by decreasing the distance between the swim bladder and inner ear, thus enabling pressure-induced swim bladder vibrations to be transduced to the inner ear. By contrast, reproductive males display enlarged swim bladder sonic muscles that enable the production of advertisement calls but also alter swim bladder morphology and increase the swim bladder to inner ear distance, effectively reducing sound pressure sensitivity. Taken together, we show that the swim bladder exhibits a seasonal functional plasticity that allows it to effectively mediate both the production and reception of sound in a vocal teleost fish.more » « less
-
Nowotny, Manuela (Ed.)Mammalian hearing operates on three basic steps: 1) sound capturing, 2) impedance conversion, and 3) frequency analysis. While these canonical steps are vital for acoustic communication and survival in mammals, they are not unique to them. An equivalent mechanism has been described for katydids (Insecta), and it is unique to this group among invertebrates. The katydid inner ear resembles an uncoiled cochlea, and has a length less than 1 mm. Their inner ears contain a hearing organ,crista acustica, which holds tonotopically arranged sensory cells for frequency mapping via travelling waves. Thecrista acusticais located on a curved triangular surface formed by the dorsal wall of the ear canal. While empirical recordings show tonotopic vibrations in the katydid inner ear for frequency analysis, the biophysical mechanism leading to tonotopy remains elusive due to the small size and complexity of the hearing organ. In this study, robust numerical simulations are developed for anin silicoinvestigation of this process. Simulations are based on the precise katydid inner ear geometry obtained by synchrotron-based micro-computed tomography, and empirically determined inner ear fluid properties for an accurate representation of the underlying mechanism. We demonstrate that the triangular structure below the hearing organ drives the tonotopy and travelling waves in the inner ear, and thus has an equivalent role to the mammalian basilar membrane. This reveals a stronger analogy between the inner ear basic mechanical networks of two organisms with ancient evolutionary differences and independent phylogenetic histories.more » « less
-
null (Ed.)The rapid evolution of the telehealth industry, accelerated recently by stay-at-home directives, has created a demand for more ubiquitous health-sensing tools. One such tool is the Spirometer. Spirometers have been used in traditional clinics to measure lung capacity (volume) as well as airflow (flow rate) and have wide applicability in the diagnosis of Asthma, COPD, and other pulmonary diseases. In addition, they can be used to diagnose Dyspnea, i.e., shortness of breath, one of the symptoms of the COVID-19 virus. Several spirometers are available commercially for home-use, but they are either costly, cumbersome or provide limited flow information. We propose SpiroMilli, a low-barrier means to performing spirometry at home using the millimeter-wave (mmWave) technology in 5G-and-beyond devices. To perform a test, users will hold the device in front of their mouth, fully inhale, then sharply exhale. The system will then output seven key indicators, e.g., Forced Vital Capacity (FVC), Peak Expiratory Flow (PEF), etc., along with a flow-volume curve. SpiroMilli’s key idea is intuitive: Strong airflow in front of the mmWave antenna creates tiny vibrations, and these vibrations affect the phase of reflected signals from nearby objects. For example, a 79 GHz device (wavelength: 3.79 mm) will register a 5 µm displacement as a 1◦ phase change.more » « less
-
Alba, D.M.; Marigó, J.; Nacarino-Meneses, C.; Villa, A. (Ed.)The end-Cretaceous mass extinction triggered the collapse of ecosystems and a drastic turnover in mammalian communities leading to the demise of many ecologically specialized species. While Mesozoic mammals were ecomorphologically diverse, recognizable ecological richness was only truly established in the Eocene. Questions remain about the ecology of the first wave of mammals radiating after the extinction. Here, we use the semicircular canals of the inner ear as a proxy for locomotor behavior. Thirty new inner ear virtual endocasts were generated using high-resolution computed tomography scanning. This sample was supplemented by data from the literature to construct a dataset of 79 fossils spanning the Jurassic to the Eocene alongside 262 extant mammals. Vestibular sensitivity was measured using the radius of curvature against body mass and the residuals of this relationship were analyzed. The petrosal lobule size relative to body mass were compared with the inner ear data as they have a role in maintaining gaze stabilization during motion. Paleocene mammals exhibited smaller canal radius of curvature, compared to Mesozoic, Eocene, and extant taxa. In the early Paleocene, canal radius and associated petrosal lobules were relatively smaller on average compared to other temporal groups, suggesting less ability for fast movements.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3563657.3596070
