An official website of the United States government
Individuals and organizations increasingly use online plat- forms to broadcast difficult problems to crowds. According to the “wisdom of the crowd” because crowds are so large they are able to bring together many diverse experts, effectively pool distributed knowledge, and thus solve challenging problems. In this study we test whether crowds of increasing size, from 4 to 32 members, perform better on a classic psychology problem that requires pooling distributed facts.
more »
« less
Distributed Knowledge in Crowds: Crowd Performance on Hidden Profile Tasks
Individuals today discuss information and form judgements as crowds in online communities and platforms. “Wisdom of the crowd” arguments suggest that, in theory, crowds have the capacity to bring together diverse expertise, pooling distributed knowledge and thereby solving challenging and complex problems. This paper concerns one way that crowds might fall short of this ideal. A large body of research in the social psychology of small groups concerns the shared information bias, a tendency for group members to focus on common knowledge at the expense of rarer information which only one or a few individuals might possess. We investigated whether this well-known bias for small groups also impacts larger crowds of 30 participants working on Amazon’s Mechanical Turk. We found that crowds failed to adequately pool distributed facts; that they were partially biased in how they shared facts; and that individual perception of group decisions was unstable. Nonetheless, we found that aggregating individual reports from the crowd resulted in moderate performance in solving the assigned task.
more »
« less
- Award ID(s):
- 1657308
- PAR ID:
- 10111000
- Date Published:
- Journal Name:
- Proceedings of the International AAAI Conference on Weblogs and Social Media
- ISSN:
- 2162-3449
- Page Range / eLocation ID:
- 405-414
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Abstract Embracing local knowledge is vital to conserve and manage biodiversity, yet frameworks to do so are lacking. We need to understand which, and how many knowledge holders are needed to ensure that management recommendations arising from local knowledge are not skewed towards the most vocal individuals. Here, we apply a Wisdom of Crowds framework to a data-poor recreational catch-and-release fishery, where individuals interact with natural resources in different ways. We aimed to test whether estimates of fishing quality from diverse groups (multiple ages and years of experience), were better than estimates provided by homogenous groups and whether thresholds exist for the number of individuals needed to capture estimates. We found that diversity matters; by using random subsampling combined with saturation principles, we determine that targeting 31% of the survey sample size captured 75% of unique responses. Estimates from small diverse subsets of this size outperformed most estimates from homogenous groups; sufficiently diverse small crowds are just as effective as large crowds in estimating ecological state. We advocate for more diverse knowledge holders in local knowledge research and application.more » « less
-
Borge-Holthoefer, Javier (Ed.)Abstract Global patterns of collective motion in bird flocks, fish schools, and human crowds are thought to emerge from local interactions within a neighborhood of interaction, the zone in which an individual is influenced by their neighbors. Both metric and topological neighborhoods have been reported in animal groups, but this question has not been addressed for human crowds. The answer has important implications for modeling crowd behavior and predicting crowd disasters such as jams, crushes, and stampedes. In a metric neighborhood, an individual is influenced by all neighbors within a fixed radius, whereas in a topological neighborhood, an individual is influenced by a fixed number of nearest neighbors, regardless of their physical distance. A recently proposed alternative is a visual neighborhood, in which an individual is influenced by the optical motions of all visible neighbors. We test these hypotheses experimentally by asking participants to walk in real and virtual crowds and manipulating the crowd's density. Our results rule out a topological neighborhood, are approximated by a metric neighborhood, but are best explained by a visual neighborhood that has elements of both. We conclude that the neighborhood of interaction in human crowds follows naturally from the laws of optics and suggest that previously observed “topological” and “metric” interactions might be a consequence of the visual neighborhood.more » « less
-
Abstract Optimizing group performance is one of the principal objectives that underlie human collaboration and prompts humans to share resources with each other. Connectivity between individuals determines how resources can be accessed and shared by the group members, yet, empirical knowledge on the relationship between the topology of the interconnecting network and group performance is scarce. To improve our understanding of this relationship, we created a game in virtual reality where small teams collaborated toward a shared goal. We conducted a series of experiments on 30 groups of three players, who played three rounds of the game, with different network topologies in each round. We hypothesized that higher network connectivity would enhance group performance due to two main factors: individuals’ ability to share resources and their arousal. We found that group performance was positively associated with the overall network connectivity, although registering a plateau effect that might be associated with topological features at the node level. Deeper analysis of the group dynamics revealed that group performance was modulated by the connectivity of high and low performers in the group. Our findings provide insight into the intricacies of group structures, toward the design of effective human teams.more » « less
-
A ubiquitous type of collective behavior and decision-making is the coordinated motion of bird flocks, fish schools, and human crowds. Collective decisions to move in the same direction, turn right or left, or split into subgroups arise in a self-organized fashion from local interactions between individuals without central plans or designated leaders. Strikingly similar phenomena of consensus (collective motion), clustering (subgroup formation), and bipolarization (splitting into extreme groups) are also observed in opinion formation. As we developed models of crowd dynamics and analyzed crowd networks, we found ourselves going down the same path as models of opinion dynamics in social networks. In this article, we draw out the parallels between human crowds and social networks. We show that models of crowd dynamics and opinion dynamics have a similar mathematical form and generate analogous phenomena in multiagent simulations. We suggest that they can be unified by a common collective dynamics, which may be extended to other psychological collectives. Models of collective dynamics thus offer a means to account for collective behavior and collective decisions without appealing to a priori mental structures.more » « less
- Free Publicly Accessible Full Text
-
Accepted Manuscript1.0
- Conference Paper:
- The DOI is not currently available.
