Human-designed systems are increasingly leveraged by data-driven methods and artificial intelligence. This leads to an urgent need for responsible design and ethical use. The goal of this conceptual paper is two-fold. First, we will introduce the Framework for Design Reasoning in Data Life-cycle Ethical Management, which integrates three existing frameworks: 1) the design reasoning quadrants framework (representing engineering design research), and 2) the data life-cycle model (representing data management), and 3) the reflexive principles framework (representing ethical decision-making). The integration of three critical components of the framework (design reasoning, data reasoning, and ethical reasoning) is accomplished by centering on the conscientious negotiation of design risks and benefits. Second, we will present an example of a student design project report to demonstrate how this framework guides educators towards delineating and integrating data reasoning, ethical reasoning, and design reasoning in settings where ethical issues (e.g., AI solutions) are commonly experienced. The framework can be implemented to design courses through design review conversations that seamlessly integrate ethical reasoning into the technical and data decision-making processes.
more »
« less
Semantic Fluency in Design Reasoning
During design, different forms of reasoning shape the designers’ decision-making. As a result, the ability to fluently transition across various forms of reasoning is essential. The purpose of this study is two-fold: first is to introduce and explain the concept of Semantic Fluency in Design Reasoning, as the ability to transition across multiple forms of reasoning fluently. To identify these transitions, this study used the Design Reasoning Quadrants framework, which represents four quadrants: experiential observations (reasoning based on observations and experiences), trade-offs (reasoning recognizing
multiple competing design requirements), first-principles (reasoning requiring disciplinary understandings), and complex abstractions (reasoning in envisioning new situations). The second purpose of this study is to illustrate semantic fluency in a design review conversation. We selected and presented three different forms of transitions identified through our analysis of conversations between students and design reviewers. Our analysis revealed evidence of semantic fluency in young designers. Mike, one of the students, demonstrated fluency across three quadrants (experiential observations,
trade-offs, and first-principles). Lisa and David demonstrated two-quadrant transitions. Lisa had fluency from experiential observations to trade-offs, and David transitioned from experiential observations to first-principles. We recommend the intentional use of design reviews to elicit student reasoning in design and adopt questioning strategies to
promote fluency across different forms of design reasoning.
more »
« less
- Award ID(s):
- 2131097
- NSF-PAR ID:
- 10396304
- Date Published:
- Journal Name:
- International journal of engineering education
- Volume:
- 38
- Issue:
- 6
- ISSN:
- 0949-149X
- Page Range / eLocation ID:
- 1891–1903
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Artificial intelligence algorithms have been used to enhance a wide variety of products and services, including assisting human decision making in high-stake contexts. However, these algorithms are complex and have trade-offs, notably between prediction accuracy and fairness to population subgroups. This makes it hard for designers to understand algorithms and design products or services in a way that respects users' goals, values, and needs. We proposed a method to help designers and users explore algorithms, visualize their trade-offs, and select algorithms with trade-offs consistent with their goals and needs. We evaluated our method on the problem of predicting criminal defendants' likelihood to re-offend through (i) a large-scale Amazon Mechanical Turk experiment, and (ii) in-depth interviews with domain experts. Our evaluations show that our method can help designers and users of these systems better understand and navigate algorithmic trade-offs. This paper contributes a new way of providing designers the ability to understand and control the outcomes of algorithmic systems they are creating.more » « less
-
Searching through memory is mediated by complex interactions between the underlying mental lexicon and the processes that operate on this lexicon. However, these interactions are difficult to study due to the effortless manner in which neurotypical individuals perform cognitive tasks. In this work, we examine these interactions within a sample of prelingually deaf individuals with cochlear implants and normal hearing individuals who were administered the verbal fluency task for the "animals" category. Specifically, we tested how different candidates for underlying mental lexicons and processes account for search behavior within the verbal fluency task across the two groups. The models learned semantic representations from different combinations of textual (word2vec) and speech-based (speech2vec) information. The representations were then combined with process models of memory search based on optimal foraging theory that incorporate different lexical sources for transitions within and between clusters of items produced in the fluency task. Our findings show that semantic, word frequency, and phonological information jointly influence search behavior and highlight the delicate balance of different lexical sources that produces successful search outcomes.more » « less
-
Wikipedia ORES Explorer: Visualizing Trade-offs For Designing Applications With Machine Learning APInull (Ed.)With the growing industry applications of Artificial Intelligence (AI) systems, pre-trained models and APIs have emerged and greatly lowered the barrier of building AI-powered products. However, novice AI application designers often struggle to recognize the inherent algorithmic trade-offs and evaluate model fairness before making informed design decisions. In this study, we examined the Objective Revision Evaluation System (ORES), a machine learning (ML) API in Wikipedia used by the community to build anti-vandalism tools. We designed an interactive visualization system to communicate model threshold trade-offs and fairness in ORES. We evaluated our system by conducting 10 in-depth interviews with potential ORES application designers. We found that our system helped application designers who have limited ML backgrounds learn about in-context ML knowledge, recognize inherent value trade-offs, and make design decisions that aligned with their goals. By demonstrating our system in a real-world domain, this paper presents a novel visualization approach to facilitate greater accessibility and human agency in AI application design.more » « less
-
null (Ed.)Moving toward a sustainable global society requires substantial change in both social and technological systems. This sustainability is dependent not only on addressing the environmental impacts of current social and technological systems, but also on addressing the social, economic and political harms that continue to be perpetuated through systematic forms of oppression and the exclusion of Black, Indigenous, and people of color (BIPOC) communities. To adequately identify and address these harms, we argue that scientists, practitioners, and communities need a transdisciplinary framework that integrates multiple types of knowledge, in particular, Indigenous and experiential knowledge. Indigenous knowledge systems embrace relationality and reciprocity rather than extraction and oppression, and experiential knowledge grounds transition priorities in lived experiences rather than expert assessments. Here, we demonstrate how an Indigenous, experiential, and community-based participatory framework for understanding and advancing socio-technological system transitions can facilitate the co-design and co-development of community-owned energy systems.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- The DOI is not currently available.
