An official website of the United States government
Individuals today discuss information and form judgements as crowds in online communities and platforms. “Wisdom of the crowd” arguments suggest that, in theory, crowds have the capacity to bring together diverse expertise, pooling distributed knowledge and thereby solving challenging and complex problems. This paper concerns one way that crowds might fall short of this ideal. A large body of research in the social psychology of small groups concerns the shared information bias, a tendency for group members to focus on common knowledge at the expense of rarer information which only one or a few individuals might possess. We investigated whether this well-known bias for small groups also impacts larger crowds of 30 participants working on Amazon’s Mechanical Turk. We found that crowds failed to adequately pool distributed facts; that they were partially biased in how they shared facts; and that individual perception of group decisions was unstable. Nonetheless, we found that aggregating individual reports from the crowd resulted in moderate performance in solving the assigned task.
more »
« less
Does Group Size Affect Problem Solving Performance in Crowds Working on a Hidden Profile Task?
Individuals and organizations increasingly use online plat- forms to broadcast difficult problems to crowds. According to the “wisdom of the crowd” because crowds are so large they are able to bring together many diverse experts, effectively pool distributed knowledge, and thus solve challenging problems. In this study we test whether crowds of increasing size, from 4 to 32 members, perform better on a classic psychology problem that requires pooling distributed facts.
more »
« less
- Award ID(s):
- 1657308
- PAR ID:
- 10072737
- Date Published:
- Journal Name:
- CHI EA '18 Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems
- Volume:
- LBW027
- Issue:
- LBW027
- Page Range / eLocation ID:
- 1 to 6
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
This study examines the organizational dynamics of social media crowds, in particular, the influence of a crowd’s emotional expression on its solidarity. To identify the relationship between emotions expressed and solidarity, marked by sustained participation in the crowd, the study uses tweets from a unique population of crowds—those tweeting about ongoing National Football League games. Observing this population permits the use of game results as quasi-random treatments on crowds, helping to reduce confounding factors. Results indicate that participation in these crowds is self-sustaining in the medium term (1 week) and can be stimulated or suppressed by emotional expression in a short term (1 hour), depending on the discrete emotion expressed. In particular, anger encourages participation while sadness discourages it. Positive emotions and anxiety have a more nuanced relationship with participation.more » « less
-
Borge-Holthoefer, Javier (Ed.)Abstract Global patterns of collective motion in bird flocks, fish schools, and human crowds are thought to emerge from local interactions within a neighborhood of interaction, the zone in which an individual is influenced by their neighbors. Both metric and topological neighborhoods have been reported in animal groups, but this question has not been addressed for human crowds. The answer has important implications for modeling crowd behavior and predicting crowd disasters such as jams, crushes, and stampedes. In a metric neighborhood, an individual is influenced by all neighbors within a fixed radius, whereas in a topological neighborhood, an individual is influenced by a fixed number of nearest neighbors, regardless of their physical distance. A recently proposed alternative is a visual neighborhood, in which an individual is influenced by the optical motions of all visible neighbors. We test these hypotheses experimentally by asking participants to walk in real and virtual crowds and manipulating the crowd's density. Our results rule out a topological neighborhood, are approximated by a metric neighborhood, but are best explained by a visual neighborhood that has elements of both. We conclude that the neighborhood of interaction in human crowds follows naturally from the laws of optics and suggest that previously observed “topological” and “metric” interactions might be a consequence of the visual neighborhood.more » « less
-
Abstract Embracing local knowledge is vital to conserve and manage biodiversity, yet frameworks to do so are lacking. We need to understand which, and how many knowledge holders are needed to ensure that management recommendations arising from local knowledge are not skewed towards the most vocal individuals. Here, we apply a Wisdom of Crowds framework to a data-poor recreational catch-and-release fishery, where individuals interact with natural resources in different ways. We aimed to test whether estimates of fishing quality from diverse groups (multiple ages and years of experience), were better than estimates provided by homogenous groups and whether thresholds exist for the number of individuals needed to capture estimates. We found that diversity matters; by using random subsampling combined with saturation principles, we determine that targeting 31% of the survey sample size captured 75% of unique responses. Estimates from small diverse subsets of this size outperformed most estimates from homogenous groups; sufficiently diverse small crowds are just as effective as large crowds in estimating ecological state. We advocate for more diverse knowledge holders in local knowledge research and application.more » « less
-
Analogy—the ability to find and apply deep structural patterns across domains—has been fundamental to human innovation in science and technology. Today there is a growing opportunity to accelerate innovation by moving analogy out of a single person’s mind and distributing it across many information processors, both human and machine. Doing so has the potential to overcome cognitive fixation, scale to large idea repositories, and support complex problems with multiple constraints. Here we lay out a perspective on the future of scalable analogical innovation and first steps using crowds and artificial intelligence (AI) to augment creativity that quantitatively demonstrate the promise of the approach, as well as core challenges critical to realizing this vision.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- https://doi.org/10.1145/3170427.3188669
