An official website of the United States government
As the internet and social media continue to become increasingly used for sharing break- ing news and important updates, it is with great motivation to study the behaviors of online users during crisis events. One of the biggest issues with obtaining information online is the veracity of such content. Given this vulnerability, misinformation becomes a very danger- ous and real threat when spread online. This study investigates misinformation debunking efforts and fills the research gap on cross-platform information sharing when misinforma- tion is spread during disasters. The false rumor “immigration status is checked at shelters” spread in both Hurricane Harvey and Hurricane Irma in 2017 and was analyzed in this paper based on a collection of 12,900 tweets. By studying the rumor control efforts made by thousands of accounts, we found that Twitter users respond and interact the most with tweets from verified Twitter accounts, and especially government organizations. Results on sourcing analysis show that the majority of Twitter users who utilize URLs in their post- ings are employing the information in the URLs to help debunk the false rumor. The most frequently cited information comes from news agencies when analyzing both URLs and domains. This paper provides novel insights into rumor control efforts made through social media during natural disasters and also the information sourcing and sharing behaviors that users exhibit during the debunking of false rumors.
more »
« less
Impact of gist intervention on automated system interpretability and user decision making
Abstract As they become more common, automated systems are also becoming increasingly opaque, challenging their users’ abilities to explain and interpret their outputs. In this study, we test the predictions of fuzzy-trace theory—a leading theory of how people interpret quantitative information—on user decision making after interacting with an online decision aid. We recruited a sample of 205 online crowdworkers and asked them to use a system that was designed to detect URLs that were part of coordinated misinformation campaigns. We examined how user endorsements of system interpretability covaried with performance on this coordinated misinformation detection task and found that subjects who endorsed system interpretability displayed enhanced discernment. This interpretability was, in turn, associated with both objective mathematical ability and mathematical self-confidence. Beyond these individual differences, we evaluated the impact of a theoretically motivated intervention that was designed to promote sensemaking of system output. Participants provided with a “gist” version of system output, expressing the bottom-line meaning of that output, were better able to identify URLs that might have been part of a coordinated misinformation campaign, compared to users given the same information presented as verbatim quantitative metrics. This work highlights the importance of enabling users to grasp the essential, gist meaning of the information they receive from automated systems, which benefits users regardless of individual differences.
more »
« less
- Award ID(s):
- 2229885
- PAR ID:
- 10547809
- Publisher / Repository:
- Springer Science + Business Media
- Date Published:
- Journal Name:
- Cognitive Research: Principles and Implications
- Volume:
- 9
- Issue:
- 1
- ISSN:
- 2365-7464
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Understanding the mechanisms by which information and misinformation spread through groups of individual actors is essential to the prediction of phenomena ranging from coordinated group behaviors to misinformation epidemics. Transmission of information through groups depends on the rules that individuals use to transform the perceived actions of others into their own behaviors. Because it is often not possible to directly infer decision-making strategies in situ, most studies of behavioral spread assume that individuals make decisions by pooling or averaging the actions or behavioral states of neighbors. However, whether individuals may instead adopt more sophisticated strategies that exploit socially transmitted information, while remaining robust to misinformation, is unknown. Here, we study the relationship between individual decision-making and misinformation spread in groups of wild coral reef fish, where misinformation occurs in the form of false alarms that can spread contagiously through groups. Using automated visual field reconstruction of wild animals, we infer the precise sequences of socially transmitted visual stimuli perceived by individuals during decision-making. Our analysis reveals a feature of decision-making essential for controlling misinformation spread: dynamic adjustments in sensitivity to socially transmitted cues. This form of dynamic gain control can be achieved by a simple and biologically widespread decision-making circuit, and it renders individual behavior robust to natural fluctuations in misinformation exposure.more » « less
-
The onus on the average person is greater than ever before to make sense of large amounts of readily accessible quantitative information, but the ability and confidence to do so are frequently lacking. Many people lack practical mathematical skills that are essential for evaluating risks, probabilities and numerical outcomes such as survival rates for medical treatments, income from retirement savings plans or monetary damages in civil trials. In this Review, we integrate research on objective and subjective numeracy, focusing on cognitive and metacognitive factors that distort human perceptions and foment systematic biases in judgement and decision making. Paradoxically, an important implication of this research is that a literal focus on objective numbers and mechanical number crunching is misguided. Numbers can be a matter of life and death but a person who uses rote strategies (verbatim representations) cannot take advantage of the information contained in the numbers because 'rote' strategies are, by definition, processing without meaning. Verbatim representations (verbatim is only surface form, not meaning) treat numbers as data as opposed to information. We highlight a contrasting approach of gist extraction: organizing numbers meaningfully, interpreting them qualitatively and making meaningful inferences about them. Efforts to improve numerical cognition and its practical applications can benefit from emphasizing the qualitative meaning of numbers in context - the gist - building on the strengths of humans as intuitive mathematicians. Thus, we conclude by reviewing evidence that gist training facilitates transfer to new contexts and, because it is more durable, longer-lasting improvements in decision making.more » « less
-
A framework is presented for understanding how misinformation shapes decision-making, which has cognitive representations of gist at its core. I discuss how the framework goes beyond prior work, and how it can be implemented so that valid scientific messages are more likely to be effective, remembered, and shared through social media, while misinformation is resisted. The distinction between mental representations of the rote facts of a message—its verbatim representation—and its gist explains several paradoxes, including the frequent disconnect between knowing facts and, yet, making decisions that seem contrary to those facts. Decision makers can falsely remember the gist as seen or heard even when they remember verbatim facts. Indeed, misinformation can be more compelling than information when it provides an interpretation of reality that makes better sense than the facts. Consequently, for many issues, scientific information and misinformation are in a battle for the gist. A fuzzy-processing preference for simple gist explains expectations for antibiotics, the spread of misinformation about vaccination, and responses to messages about global warming, nuclear proliferation, and natural disasters. The gist, which reflects knowledge and experience, induces emotions and brings to mind social values. However, changing mental representations is not sufficient by itself; gist representations must be connected to values. The policy choice is not simply between constraining behavior or persuasion—there is another option. Science communication needs to shift from an emphasis on disseminating rote facts to achieving insight, retaining its integrity but without shying away from emotions and values.more » « less
-
Ubiquitous misinformation on social media threatens the health and well-being of young people. We review research on susceptibility to misinformation, why it spreads, and how these mechanisms might operate developmentally. Although we identify many research gaps, results suggest that cognitive ability, thinking styles, and metacognitive scrutiny of misinformation are protective, but early adverse experiences can bias information processing and sow seeds of mistrust. We find that content knowledge is not sufficient to protect against misinformation, but that it, along with life experiences, provides a foundation for gist plausibility (true in principle, rather than true at the level of verbatim details) that likely determines whether misinformation is accepted and shared. Thus, we present a theoretical framework based on fuzzy-trace theory that integrates the following: knowledge that distinguishes verbatim facts from gist (knowledge that is amplified by cognitive faculties and derived from trusted sources); personality as an information-processing filter colored by experiences; emotion as a product of interpreting the gist of information; and ideology that changes prior probabilities and gist interpretations of what is plausible. The young and the old may be at greatest risk because of their prioritization of social goals, a need that social media algorithms are designed to meet but at the cost of widespread exposure to misinformation.more » « less
