More Like this

1. Regretful Decisions under Label Noise

   Nagaraj, Sujay; Liu, Yang; Calmon, Flavio; Ustun, Berk (April 2025, 13th International Conference on Learning Representations (ICLR 2025))
2. Regretful Decisions under Label Noise

   Nagaraj, Sujay; Liu, Yang; Calmon, Flavio P; Ustun, Berk (April 2025, ICLR 2025)

   Machine learning models are routinely used to support decisions that affect individuals -- be it to screen a patient for a serious illness or to gauge their response to treatment. In these tasks, we are limited to learning models from datasets with noisy labels. In this paper, we study the instance-level impact of learning under label noise. We introduce a notion of regret for this regime, which measures the number of unforeseen mistakes due to noisy labels. We show that standard approaches to learning under label noise can return models that perform well at a population-level while subjecting individuals to a lottery of mistakes. We present a versatile approach to estimate the likelihood of mistakes at the individual-level from a noisy dataset by training models over plausible realizations of datasets without label noise. This is supported by a comprehensive empirical study of label noise in clinical prediction tasks. Our results reveal how failure to anticipate mistakes can compromise model reliability and adoption -- we demonstrate how we can address these challenges by anticipating and avoiding regretful decisions. 

   more » « less
3. Sample Average Approximation For Functional Decisions Under Shape Constraints

   https://doi.org/10.1109/WSC48552.2020.9384071  

   Singham, Dashi I.; Lam, Henry (January 2020, Winter Simulation Conference)

   null (Ed.)
4. A Collaborator's Reputation Can Bias Decisions and Anxiety under Uncertainty

   https://doi.org/10.1523/JNEUROSCI.2337-17.2018  

   Qi, Song; Footer, Owen; Camerer, Colin F.; Mobbs, Dean (February 2018, The Journal of Neuroscience)
5. A Game-Theoretic Research Platform for Team-based Design Decisions under Competition

   https://doi.org/10.1017/pds.2025.10024  

   Li, Xiang; Chen, Siyu; Bayrak, Alparslan Emrah; Sha, Zhenghui (August 2025, Proceedings of the Design Society)

   Design decision-making under competition is a critical challenge in real-world engineering design. These challenges are compounded by bounded rationality, where cognitive limitations and imperfect information influence decision-making strategies. To address these issues, we develop a game-theoretic research platform to investigate team-based design under competition. This platform abstracts and simulates real-world competitive design scenarios through controlled experiments. It features a user-friendly interface to collect behavioral data, which supports the analysis of team and individual strategies. Additionally, we validated the platform through a pilot study, demonstrating its ability to capture realistic design features and generate meaningful insights into competitive design behaviors. 

   more » « less