An official website of the United States government
Determining an individual’s strategic reasoning capability based solely on choice data is a complex task. This complexity arises because sophisticated players might have non-equilibrium beliefs about others, leading to non-equilibrium actions. In our study, we pair human participants with computer players known to be fully rational. This use of robot players allows us to disentangle limited reasoning capacity from belief formation and social biases. Our results show that, when paired with robots, subjects consistently demonstrate higher levels of rationality, compared to when paired with human players. Furthermore, players’ rationality levels are relatively stable across games when paired with robot players, even though those with intermediate rationality levels exhibit inconsistency across games. Leveraging our experimental design, we identify and document potential causes of this inconsistency.
more »
« less
This content will become publicly available on August 1, 2026
A Quantitative Analysis of Rational Decisions Under Uncertainty in Engineering Systems Design
Rational decision-making is crucial in the later stages of engineering system design to allocate resources efficiently and minimize costs. However, human rationality is bounded by cognitive biases and limitations. Understanding how humans deviate from rationality is critical for guiding designers toward better design outcomes. In this paper, we quantify designer rationality in competitive scenarios based on utility theory. Using an experiment inspired by crowd-sourced contests, we show that designers employ varied search strategies. Some participants approximate a Bayesian agent that aimed to maximize its expected utility. Those with higher rationality reduce uncertainty more effectively. Furthermore, rationality correlates with both the proximity to optimal design and design iteration costs, with winning participants exhibiting greater rationality than losing participants.
more »
« less
- Award ID(s):
- 2419423
- PAR ID:
- 10636310
- Publisher / Repository:
- Cambridge University Press
- Date Published:
- Journal Name:
- Proceedings of the Design Society
- Volume:
- 5
- Issue:
- ICED2025
- ISSN:
- 2732-527X
- Page Range / eLocation ID:
- 249 to 258
- Subject(s) / Keyword(s):
- bounded rationality utility theory decision under uncertainty Bayesian optimization
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
In the U.S., the fifth largest ‘‘crop’’ is vegetation dedicated to environmental conservation. Over 22 million acres of perennial covers are planted on environmentally sensitive land enrolled in U.S. Department of Agriculture’s Conservation Reserve Program (CRP), one of the largest agricultural conservation programs in the world. About half of CRP lands are enrolled through a complex reverse auction called the General Signup. The communication of program options to participants could have an important behavioral impact. Psychologists have found that information presentation in complex decision environments can interact with the bounded rationality and cognitive biases of decision makers. We tested two changes in the status quo CRP decision environment using an incentivized, lab-in-the-field experiment with 701 prior General Signup participants. First, program participants typically make an active choice over which cover practice to plant and how much of a discount to offer, where the discount is a reduction in their annual program payment. Changing that default to an opt-out, high-scoring offer resulted in a 13 percentage point increase in selection of the best practice and a 48 percent increase in the average discount. In the actual CRP, that increase in discounting would reduce total program costs by about $30 million per signup. Second, shifting to real-time updating of offer scores modestly reduced the frequency with which participants revised their offers, suggesting a reduction in transaction costs. From a policy perspective, these results suggest that small changes in conservation auctions could both improve the quality of conservation practices and reduce program costs.more » « less
-
Throughout the design process, designers encounter diverse stimuli that influence their work. This influence is particularly notable during idea generation processes that are augmented by novel design support tools that assist in inspiration discovery. However, fundamental questions remain regarding why and how interactions afforded by these tools impact design behaviors. This work explores how designers search for inspirational stimuli using an AI-enabled multi-modal search platform, which supports queries by text and non-text-based inputs. Student and professional designers completed a think-aloud design exploration task using this platform to search for stimuli to inspire idea generation. We identify expertise and search modality as factors influencing design exploration, including the frequency and framing of searches, and the evaluation and utility of search results.more » « less
-
In designing complex systems, systems engineers strive to turn an existing situation into a situation that is most preferred. A rational decision maker would choose the alternative that maximizes the expected utility of the existing situation, but there are significant computational challenges to this approach. To overcome these challenges, most decision makers revert to heuristics. In this paper, we propose a conceptual framework for heuristics in design. A preliminary empirical study of designers for a robotics design problem was conducted to observe how participants apply heuristics. Participants having at least 2 years of experience designing robots were recruited to partake in a robotics design session in which participant were given 45 minutes to work on a design problem. A preliminary heuristics extraction method was developed, and the identified heuristics were studied to find trends within the overall set. These trends were the basis of a taxonomy of heuristics consisting of three initial classification methods: design phase, field of study, and action intent. The heuristics and classifications are presented, along with the challenges from extracting heuristics and recommendations for future work to further research design heuristics and to improve the method for extraction.more » « less
-
Cultural background influences aesthetic web design preferences, and aesthetic design impacts accessible design. However, limited research has focused on this intersection of cultural background and accessible web design. With the majority of HCI and design resources originating from the Global North, we investigated the conflicts experienced due to the cultural background of digital designers from the Global South and current web accessibility guidelines. We conducted a design activity and interview study with 10 designers from five countries in the Global South to identify how current web accessibility guidelines conflict with our participants’ cultural design preferences. We found there are specific cultural challenges encountered in accessible web design, both at the design level (e.g., typography and color scheme) and within broader societal contexts (e.g., designer-client interactions). Our paper also offers suggestions from our participants to make the accessible design process more culturally inclusive by improving the web accessibility resources to become culturally customized and engaging more cultural perspectives in accessibility research and education.more » « less
