skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Gathering as Design Process: Physical Prototyping for Culturally Sustaining Computational Technologies
To address pressing issues of bias and black boxing embedded in technologies and their underlying computational models, scholars call for inventing and employing design processes that invite participation from those whose lives are shaped by these technologies. In response, we reimagine not only how technologies and their models are designed, but also who designs them. We present our work toward developing the concept of gathering as a design process that invites physical prototyping as an important mechanism in developing culturally sustaining technologies. Gathering is inspired by “Hui,” an ‘Ōlelo Hawai‘i Hawaiian language word translated as: to band together, assemble, organize. We share our ongoing journey of inventing and engaging in gathering and present four characteristics of gathering as a design process. Our work has implications for how we design new forms of technology toward more equitable futures, especially by making visible decision making and sensemaking that occurs throughout the design process.  more » « less
Award ID(s):
2119573
PAR ID:
10435063
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Learning, Design and Technology (LDT ’23)
Page Range / eLocation ID:
107 to 113
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Abstract The objective of this study is to investigate students’ decision-making during the information gathering activities of a design process. Existing literature in engineering education has shown that students face difficulties while gathering information in various activities of a design process such as brainstorming and CAD modeling. Decision-making is an important aspect of these activities. While gathering information, students make several decisions such as what information to acquire and how to acquire that information. There lies a research gap in understanding how students make decisions while gathering information in a product design process. To address this gap, we conduct semi-structured interviews and surveys in a product design course. We analyze the students’ decision-making activities from the lens of a sequential information acquisition and decision-making (SIADM) framework. We find that the students recognize the need to acquire information about the physics and dynamics of their design artifact during the CAD modeling activity of the product design process. However, they do not acquire such information from their CAD models primarily due to the lack of the project requirements, their ability, and the time to do so. Instead, they acquire such information from the prototyping activity as their physical prototype does not satisfy their design objectives. However, the students do not get the opportunity to iterate their prototype with the given cost and time constraints. Consequently, they rely on improvising during prototyping. Based on our observations, we discuss the need for designing course project activities such that it facilitates students’ product design decisions. 
    more » « less
  2. Objectives We examine the community epistemologies in youth’s iterative refinements of STEM-rich inventions across settings and time. Iteration in STEM-rich engineering/invention work refers to re-thinking ideas/designs within prototyping processes (Cunningham & Kelly, 2017). The objective of this paper is to examine the political dimensions of iteration through a) how iteration involves pre- and post-design “lives” of inventions especially towards new social futures, and b) the intentional incorporation of cultural epistemologies towards advancing new forms of legitimate inventor knowledge/practice (Yosso, 2005). Framing We draw from critical justice and consequential learning studies. Critical justice focuses on recognizing diversity and addressing structural inequalities perpetuated through systemic racism and classism. It seeks re-shifted relations of power and position within multiple scales-of-activity in learning, intersected with historicized injustices in learning environments. Consequential learning examines what matters to people, and how associated values and practices, when coordinated through social activity, allows for imagining new social futures (Gutierrez, 2012). Viewing the iterative process of inventing through a justice-oriented consequential lens calls into question traditional modes of knowing, and challenges/expands who and what areas of expertise are recognized and valued. Methods Our study takes place in two community makerspaces in mid-sized cities. Both center community engagement and support youth in designing/inventing to address problems they and their communities care about. Both also support minoritized youth in inventing through engagement with a wide range of community/STEM stakeholders. In researcher-educator roles, we collaborated with both makerspaces to establish programs supporting youth in sustained engagement in STEM and making/inventing in culturally-sustaining ways. In our two-year, longitudinal critical ethnography, data were generated in weekly community making sessions between 2016-2018. Data include artifacts, youth conversation groups, and videos capturing youth interaction with STEM and community experts at various stages in their design process. Analysis involved multiple stages and levels of coding based on open-coding and constant comparison procedures. Findings We ground our paper in four in-depth longitudinal cases of youth’s iterative design work: Nila’s light-up #stopracism sign; Su’zanne’s massaging slipper, Sharon’s geodesic play dome, and Jazmyn’s portable fan. Across cases, we illustrate three findings. First, youth located broader injustices within local making/inventing discourses with support from community and STEM allies, suggesting youth drew from multiple epistemologies, some grounded in community cultural wealth, others in STEM. For example, Su’Zanne drew from a familial culture of care and resistance in recognizing injustices nested in homelessness while iterating a way to make her slipper “more massaging.” The geodesic dome youth-makers drew from collective solidarity/resistance in making a structure for younger peers due to unjust lack of play infrastructure. Second, iterative engagement involving community wealth afforded further design and inventing experiences and expanded ownership over inventions across many stakeholders. For example, youth turned Nila’s #stopracism sign on during group discussions when they felt that racism needed to be foregrounded. Third, the afterlife of youth invention processes impacted the emergent inventor-maker culture through influencing the iterative process. Significance Iterations expand hybridization of cultural knowledge/practice and STEM-rich inventing, re-shaping whose cultural knowledge matters, and fostering justice-oriented collective outcomes. 
    more » « less
  3. Blikstein, Paolo; Van_Aalst, Jan; Kizito, Rita; Brennan, Karen (Ed.)
    A core practice of science is planning and conducting investigations. This practice needs reconceptualizing, to account for where work happens between identifying a phenomenon and designing an investigation, and between gathering and analyzing data to support developing an explanation of that phenomenon (Manz et al., 2020). Teachers, supported by curriculum materials, need to engage students in becoming more involved in the decisions related to what data to choose as evidence, how to represent data to answer specific questions, and what conclusions can be drawn from data. We present results of a design study in which students investigated a dataset to answer a question about a major change to an ecosystem, using a technology tool, CODAP. We explore how the curriculum and teacher supported students in taking up different facets of data practices that support figuring out a phenomenon while moving between investigating and developing explanatory models. 
    more » « less
  4. Ensuring effective public understanding of algorithmic decisions that are powered by machine learning techniques has become an urgent task with the increasing deployment of AI systems into our society. In this work, we present a concrete step toward this goal by redesigning confusion matrices for binary classification to support non-experts in understanding the performance of machine learning models. Through interviews (n=7) and a survey (n=102), we mapped out two major sets of challenges lay people have in understanding standard confusion matrices: the general terminologies and the matrix design. We further identified three sub-challenges regarding the matrix design, namely, confusion about the direction of reading the data, layered relations and quantities involved. We then conducted an online experiment with 483 participants to evaluate how effective a series of alternative representations target each of those challenges in the context of an algorithm for making recidivism predictions. We developed three levels of questions to evaluate users’ objective understanding. We assessed the effectiveness of our alternatives for accuracy in answering those questions, completion time, and subjective understanding. Our results suggest that (1) only by contextualizing terminologies can we significantly improve users’ understanding and (2) flow charts, which help point out the direction of reading the data, were most useful in improving objective understanding. Our findings set the stage for developing more intuitive and generally understandable representations of the performance of machine learning models 
    more » « less
  5. Engineering designers are tasked with complex problems necessitating the use and development of various supports for navigating complexity. Prescriptive design process models are one such tool. However, little research has explored how engineering designers perceive these models' recommendations for engagement in design work. In this exploratory study, we analyzed data from individual semi-structured interviews with 18 mechanical engineering students to identify participant perceptions of design process models. As many design process model visualizations lack explicit attention to some social and contextual dimensions, we sought to compare perceptions among two models drawn from engineering texts and one model that was developed with the intent to emphasize social and contextual dimensions. We identified perceptions of the recommendations from the design process models related to starting and moving through a design process, gathering information, prototyping, evaluating or testing, and what they should consider. Participant perceptions across the three process models suggest different design process models make perceptions of certain recommendations more salient than others. However, participant perceptions also varied for the same process model. We suggest several implications for design education and training based on participant perceptions of the process models, particularly the importance of leveraging multiple design process models. The comprehensive descriptions of participant perceptions provide a foundation for further investigations bridging designers' perceptions to intent, behavior, and, ultimately, design outcomes. 
    more » « less