This paper examines the factors that govern persuasion for a priori UNDECIDED versus DECIDED audience members in the context of on-line debates. We separately study two types of influences: linguistic factors — features of the language of the debate itself; and audience factors — features of an audience member encoding demographic information, prior beliefs, and debate platform behavior. In a study of users of a popular debate platform, we find first that different combinations of linguistic features are critical for predicting persuasion outcomes for UNDECIDED versus DECIDED members of the audience. We additionally find that audience factors have more influence on predicting the side (PRO/CON) that persuaded UNDECIDED users than for DECIDED users that flip their stance to the opposing side. Our results emphasize the importance of considering the undecided and decided audiences separately when studying linguistic factors of persuasion.
more »
« less
Exploring the Role of Prior Beliefs for Argument Persuasion
Public debate forums provide a common platform for exchanging opinions on a topic of interest. While recent studies in natural language processing (NLP) have provided empirical evidence that the language of the debaters and their patterns of interaction play a key role in changing the mind of a reader, research in psychology has shown that prior beliefs can affect our interpretation of an argument and could therefore constitute a competing alternative explanation for resistance to changing one’s stance. To study the actual effect of language use vs. prior beliefs on persuasion, we provide a new dataset and propose a controlled setting that takes into consideration two reader-level factors: political and religious ideology. We find that prior beliefs affected by these reader-level factors play a more important role than language use effects and argue that it is important to account for them in NLP studies of persuasion.
more »
« less
- Award ID(s):
- 1741441
- PAR ID:
- 10075229
- Date Published:
- Journal Name:
- Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies
- Volume:
- 1 (Long papers)
- Page Range / eLocation ID:
- 1035 - 1045
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
Every day people share personal stories online, reaching millions of users around the world through blogs, social media and news websites. Why are some of these stories more attractive to readers than others? What features of these personal narratives make readers empathize with the storyteller? Do the readers’ personal characteristics and experiences play a role in feeling connection to the story they read? Experimental studies in psychology show that there are several factors that increase empathy in the aggregate, but there is a need for deeper understanding of empathetic feelings at the individual level of storyteller, story, and reader. Here, we present the design and analysis of a survey that studied the impact of story features and reader predispositions and perceptions on the empathy they feel when reading online stories. We use causal trees to find the individual-level causal factors for empathy and to understand the heterogeneity in the treatment effects. One of our main findings is that empathy is contextual and, while reader personality plays a significant role in evoking empathy, the mood of the reader prior to reading the story and linguistic story features have an impact as well. The results of our analyses can be used to help people create content that others care about and to help them communicate more effectivelymore » « less
-
Debate is a process that gives individuals the opportunity to express, and to be exposed to, diverging viewpoints on controversial issues; and the existence of online debating platforms makes it easier for individuals to participate in debates and obtain feedback on their debating skills. But understanding the factors that contribute to a user’s success in debate is complicated: while success depends, in part, on the characteristics of the language they employ, it is also important to account for the degree to which their beliefs and personal traits are compatible with that of the audience. Friendships and previous interactions among users on the platform may further influence success. In this work, we aim to better understand the mechanisms behind success in online debates. In particular, we study the relative effects of debaters’ language, their prior beliefs and personal traits, and their social interactions with other users. We find, perhaps surprisingly, that characteristics of users’ social interactions play the most important role in determining their success in debates although the best predictive performance is achieved by combining social interaction features with featuresmore » « less
-
Natural resource managers (managers) value and use scientific information to inform their decision-making process in a variety of ways. The scientific information managers use depends on a variety of factors, including the source of the information and ease of access. Barriers, such as paywalls, insufficient capacity, and information overload play an important role in determining what scientific information managers have access and attend to. Additionally, characteristics of managers themselves also influence what scientific information they prioritize and implement. Specific factors likely play an important role in how managers evaluate the utility and strength of scientific information. We examine two potential factors, (1) the number of years of the study as an indicator of research quality, and (2) the cognitive bias to prefer confirming information. We surveyed public land managers in Oregon and Washington, USA and used a 2x2 experimental design to evaluate how time frame and agreement with prior beliefs influences the perceived usefulness of scientific information and the soundness of management prescriptions for three management issues: post-fire salvage logging, variable density thinning of mature growth stands, and translocation of native species as a climate adaptation behavior. We find in general respondents equally value the results of long-term and short-term studies but prefer information that confirms their pre-existing beliefs over information that challenges them. In open-ended responses about the soundness of action prescriptions, we found across all conditions respondents were resistant to adopting a management action because of the results of the example studies. Although previous research has examined the barriers and facilitators to getting managers access to scientific information, our study highlights the ways the mere provisioning of information does not guarantee its use, as managers evaluate information in light of their pre-existing values and beliefs. Scientists, science communicators, and boundary spanners should consider what characteristics managers use to evaluate the usefulness and applicability of information when designing studies and framing and communicating results.more » « less
-
In this paper we argue that embodied multimodal agents, i.e., avatars, can play an important role in moving natural language processing toward “deep understanding.” Fully featured interactive agents, model encounters between two “people,” but a language-only agent has little environmental and situational awareness. Multimodal agents bring new opportunities for interpreting visuals, locational information, gestures, etc., which are more axes along which to communicate. We propose that multimodal agents, by facilitating an embodied form of human-computer interaction, provide additional structure that can be used to train models that move NLP systems closer to genuine “understanding” of grounded language, and we discuss ongoing studies using existing systems.more » « less
An official website of the United States government

