Abstract Context effects occur when the preference between two alternatives is affected by the presence of an extra alternative. These effects are some of the most well studied phenomena in multi-alternative, multi-attribute decision making. Recent research in this area has revealed an intriguing pattern of results. On the one hand, these effects are robust and ubiquitous. That is, they have been demonstrated in many domains and different choice settings. On the other hand, they are fragile and they disappear or even reverse under different conditions. This pattern of results has spurred debate and speculation about the cognitive mechanisms that drive these choices. The attraction effect, where the preference for an option increases in the presence of a dominated decoy, has generated the most controversy. In this registered report, we systematically vary factors that are known to be associated with the attraction effect to build a solid foundation of empirical results to aid future theory development. We find a robust attraction effect across the different conditions. The strength of this effect is modulated by the display order (e.g., decoy top, target middle, competitor bottom) and mode (numeric vs. graphical) but not display layout (by-attribute vs. by-alternative).
more »
« less
Reconciling the Paradoxical Findings of Choice Overload Through an Analytical Lens
Too much of a good thing can be harmful. Choice overload, a compelling paradox in consumer psychology, exemplifies this notion with the idea that offering more product options could impede rather than improve consumer satisfaction, even when consumers are free to ignore any available option. After attracting intense interest in the past decades from multiple disciplines, research on choice overload has produced voluminous yet paradoxical findings that are widely perceived as inconsistent even at the meta-analytic level. This paper launches an interdisciplinary inquiry to resolve the inconsistencies on both the conceptual and empirical fronts. Specifically, we identified a surprising butrobust pattern among the existing empirical evidence for the choiceoverload effect and demonstrated through mathematical analysis and extensive simulation studies that the pattern would only likely emerge from one specific type of latent mechanism underlying the moderated choiceoverload effect. The paper discusses the research and practical implications of our findings—namely, the broad promise of analytical meta-analysis (an emerging area for the use of data analytics) and machine learning to address the widely recognized inconsistencies in social and behavioral sciences, and the unique and salient role of the information systems community in developing this new era of meta-analysis.
more »
« less
- PAR ID:
- 10481276
- Publisher / Repository:
- MISQ
- Date Published:
- Journal Name:
- MIS Quarterly
- Volume:
- 45
- Issue:
- 4
- ISSN:
- 0276-7783
- Page Range / eLocation ID:
- 1893 to 1920
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a baseline for interpreting effect-size estimates, in turn producing more stringent thresholds for hypothesis testing and for statistical-power calculations. An examination of recent meta-analyses in psychology, neuroscience, and medicine confirms that, even if all considered effects are real, results involving small effects are indeed indistinguishable from random conclusions.more » « less
-
Abstract Investigating the effectiveness of instructional practices provides an evidence base to inform instructional decisions. Synthesizing research studies on instructional effectiveness provides an estimate of the generalizability of effectiveness across settings, along with an exploration of factors that may moderate the impact, which cannot be achieved within individual studies. This study sought to provide a synthesis of evidence‐based instructional practices (EBIPs) particular to chemistry through meta‐analysis. Ninety‐nine studies were analyzed comprising a broader view of chemistry specific studies than past meta‐analyses. The results showed that EBIPs feature a demonstrably positive impact on students' academic performance in chemistry, although assessment topic coverage and setting size emerged as relevant moderators of impact and prevented making definitive conclusions of the relative impact of each EBIP. In examining publication bias, an asymmetric distribution of studies based on standard error(SE)and effect size was found, indicative of potential publication bias. To explore the potential impact of bias, the trim and fill method was employed resulting in a range for the overall weighted effect size from 0.29 to 0.62. The study concludes that evidence‐based instructional practices have demonstrated effectiveness even in consideration of potential publication bias, as the range of effect sizes remains positive, but highlights the continued need to publish null findings in the research literature.more » « less
-
Deceptive and coercive design practices are increasingly used by companies to extract profit, harvest data, and limit consumer choice. Dark patterns represent the most common contemporary amalgamation of these problematic practices, connecting designers, technologists, scholars, regulators, and legal professionals in transdisciplinary dialogue. However, a lack of universally accepted definitions across the academic, legislative, practitioner, and regulatory space has likely limited the impact that scholarship on dark patterns might have in supporting sanctions and evolved design practices. In this paper, we seek to support the development of a shared language of dark patterns, harmonizing ten existing regulatory and academic taxonomies of dark patterns and proposing a three-level ontology with standardized definitions for 64 synthesized dark pattern types across low-, meso-, and high-level patterns. We illustrate how this ontology can support translational research and regulatory action, including transdisciplinary pathways to extend our initial types through new empirical work across application and technology domains.more » « less
-
null (Ed.)State aggregation is a popular model reduction method rooted in optimal control. It reduces the complexity of engineering systems by mapping the system’s states into a small number of meta-states. The choice of aggregation map often depends on the data analysts’ knowledge and is largely ad hoc. In this paper, we propose a tractable algorithm that estimates the probabilistic aggregation map from the system’s trajectory. We adopt a soft-aggregation model, where each meta-state has a signature raw state, called an anchor state. This model includes several common state aggregation models as special cases. Our proposed method is a simple two- step algorithm: The first step is spectral decomposition of empirical transition matrix, and the second step conducts a linear transformation of singular vectors to find their approximate convex hull. It outputs the aggregation distributions and disaggregation distributions for each meta-state in explicit forms, which are not obtainable by classical spectral methods. On the theoretical side, we prove sharp error bounds for estimating the aggregation and disaggregation distributions and for identifying anchor states. The analysis relies on a new entry-wise deviation bound for singular vectors of the empirical transition matrix of a Markov process, which is of independent interest and cannot be deduced from existing literature. The application of our method to Manhattan traffic data successfully generates a data-driven state aggregation map with nice interpretations.more » « less
An official website of the United States government

