An official website of the United States government
Abstract Context effects occur when the preference between two alternatives is affected by the presence of an extra alternative. These effects are some of the most well studied phenomena in multi-alternative, multi-attribute decision making. Recent research in this area has revealed an intriguing pattern of results. On the one hand, these effects are robust and ubiquitous. That is, they have been demonstrated in many domains and different choice settings. On the other hand, they are fragile and they disappear or even reverse under different conditions. This pattern of results has spurred debate and speculation about the cognitive mechanisms that drive these choices. The attraction effect, where the preference for an option increases in the presence of a dominated decoy, has generated the most controversy. In this registered report, we systematically vary factors that are known to be associated with the attraction effect to build a solid foundation of empirical results to aid future theory development. We find a robust attraction effect across the different conditions. The strength of this effect is modulated by the display order (e.g., decoy top, target middle, competitor bottom) and mode (numeric vs. graphical) but not display layout (by-attribute vs. by-alternative).
more »
« less
Reconciling the Paradoxical Findings of Choice Overload Through an Analytical Lens
Too much of a good thing can be harmful. Choice overload, a compelling paradox in consumer psychology, exemplifies this notion with the idea that offering more product options could impede rather than improve consumer satisfaction, even when consumers are free to ignore any available option. After attracting intense interest in the past decades from multiple disciplines, research on choice overload has produced voluminous yet paradoxical findings that are widely perceived as inconsistent even at the meta-analytic level. This paper launches an interdisciplinary inquiry to resolve the inconsistencies on both the conceptual and empirical fronts. Specifically, we identified a surprising butrobust pattern among the existing empirical evidence for the choiceoverload effect and demonstrated through mathematical analysis and extensive simulation studies that the pattern would only likely emerge from one specific type of latent mechanism underlying the moderated choiceoverload effect. The paper discusses the research and practical implications of our findings—namely, the broad promise of analytical meta-analysis (an emerging area for the use of data analytics) and machine learning to address the widely recognized inconsistencies in social and behavioral sciences, and the unique and salient role of the information systems community in developing this new era of meta-analysis.
more »
« less
- PAR ID:
- 10481276
- Publisher / Repository:
- MISQ
- Date Published:
- Journal Name:
- MIS Quarterly
- Volume:
- 45
- Issue:
- 4
- ISSN:
- 0276-7783
- Page Range / eLocation ID:
- 1893 to 1920
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Conducting research with human subjects can be difficult because of limited sample sizes and small empirical effects. We demonstrate that this problem can yield patterns of results that are practically indistinguishable from flipping a coin to determine the direction of treatment effects. We use this idea of random conclusions to establish a baseline for interpreting effect-size estimates, in turn producing more stringent thresholds for hypothesis testing and for statistical-power calculations. An examination of recent meta-analyses in psychology, neuroscience, and medicine confirms that, even if all considered effects are real, results involving small effects are indeed indistinguishable from random conclusions.more » « less
-
Abstract Investigating the effectiveness of instructional practices provides an evidence base to inform instructional decisions. Synthesizing research studies on instructional effectiveness provides an estimate of the generalizability of effectiveness across settings, along with an exploration of factors that may moderate the impact, which cannot be achieved within individual studies. This study sought to provide a synthesis of evidence‐based instructional practices (EBIPs) particular to chemistry through meta‐analysis. Ninety‐nine studies were analyzed comprising a broader view of chemistry specific studies than past meta‐analyses. The results showed that EBIPs feature a demonstrably positive impact on students' academic performance in chemistry, although assessment topic coverage and setting size emerged as relevant moderators of impact and prevented making definitive conclusions of the relative impact of each EBIP. In examining publication bias, an asymmetric distribution of studies based on standard error(SE)and effect size was found, indicative of potential publication bias. To explore the potential impact of bias, the trim and fill method was employed resulting in a range for the overall weighted effect size from 0.29 to 0.62. The study concludes that evidence‐based instructional practices have demonstrated effectiveness even in consideration of potential publication bias, as the range of effect sizes remains positive, but highlights the continued need to publish null findings in the research literature.more » « less
-
Deceptive and coercive design practices are increasingly used by companies to extract profit, harvest data, and limit consumer choice. Dark patterns represent the most common contemporary amalgamation of these problematic practices, connecting designers, technologists, scholars, regulators, and legal professionals in transdisciplinary dialogue. However, a lack of universally accepted definitions across the academic, legislative, practitioner, and regulatory space has likely limited the impact that scholarship on dark patterns might have in supporting sanctions and evolved design practices. In this paper, we seek to support the development of a shared language of dark patterns, harmonizing ten existing regulatory and academic taxonomies of dark patterns and proposing a three-level ontology with standardized definitions for 64 synthesized dark pattern types across low-, meso-, and high-level patterns. We illustrate how this ontology can support translational research and regulatory action, including transdisciplinary pathways to extend our initial types through new empirical work across application and technology domains.more » « less
-
Identifying patterns is an important part of mathematical investigation, but many students struggle to explain or justify their pattern-based generalizations or conjectures. These findings have led some researchers to argue for a de-emphasis on pattern-based activities, but others argue that empirical investigation can support the discovery of insight into a problem’s structure. We introduce a phenomenon we call empirical re-conceptualization, in which learners identify a conjecture based on an empirical pattern, and then re-interpret that conjecture from a structural perspective. We elaborate this construct by drawing on interview data from undergraduate calculus students and research mathematicians, providing a representative example of empirical re-conceptualization from each participant group. Our findings indicate that developing empirical results can foster subsequent insights, which can in turn lead to justification and proof.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Journal Article:
- https://doi.org/10.25300/MISQ/2021/16954
