skip to main content


Title: Students or Mechanical Turk: Who Are the More Reliable Social Media Data Labelers? [Students or Mechanical Turk: Who Are the More Reliable Social Media Data Labelers?]
Award ID(s):
1934925 1934494
NSF-PAR ID:
10351562
Author(s) / Creator(s):
; ; ;
Date Published:
Journal Name:
Proceedings of the 11th International Conference on Data Science, Technology and Applications - DATA
Page Range / eLocation ID:
408 to 415
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. null (Ed.)
    Considerable amount of laboratory and survey‐based research finds that people show disproportional compassionate and affective response to the scope of human mortality risk. According to research on “psychic numbing,” it is often the case that the more who die, the less we care. In the present article, we examine the extent of this phenomenon in verbal behavior, using large corpora of natural language to quantify the affective reactions to loss of life. We analyze valence, arousal, and specific emotional content of over 100,000 mentions of death in news articles and social media posts, and find that language shows an increase in valence (i.e., decreased negative affect) and a decrease in arousal when describing mortality of larger numbers of people. These patterns are most clearly reflected in specific emotions of joy and (in a reverse fashion) of fear and anger. Our results showcase a novel methodology for studying affective decision making, and highlight the robustness and real‐world relevance of psychic numbing. They also offer new insights regarding the psychological underpinnings of psychic numbing, as well as possible interventions for reducing psychic numbing and overcoming social and psychological barriers to action in the face of the world's most serious threats. 
    more » « less
  2. null (Ed.)
    This paper studies conspiracy and debunking narratives about the origins of COVID-19 on a major Chinese social media platform, Weibo, from January to April 2020. Popular conspiracies about COVID-19 on Weibo, including that the virus is human-synthesized or a bioweapon, differ substan-tially from those in the United States. They attribute more responsibility to the United States than to China, especially following Sino-U.S. confrontations. Compared to conspiracy posts, debunking posts are associated with lower user participation but higher mobilization. Debunking narratives can be more engaging when they come from women and influencers and cite scientists. Our find-ings suggest that conspiracy narratives can carry highly cultural and political orientations. Correc-tion efforts should consider political motives and identify important stakeholders to reconstruct international dialogues toward intercultural understanding. 
    more » « less
  3. null (Ed.)
    Students who speak English as a second language (ESL) are underserved and underrepresented in postsecondary science, technology, engineering, and math (STEM) fields. To date, most existing research with ESL students in higher education is qualitative. Drawing from this important body of work, we investigate the impact of a social-belonging intervention on anticipated changes in belonging, STEM GPA, and proportion of STEM credits obtained in students’ first semester and first year of college. Using data from more than 12,000 STEM-interested students at 19 universities, results revealed that the intervention increased ESL students’ anticipated sense of belonging and three of the four academic outcomes. Moreover, anticipated changes in belonging mediated the intervention’s effects on these academic outcomes. Robustness checks revealed that ESL effects persisted even when controlling for other identities correlated with ESL status. Overall, results suggest that anticipated belonging is an understudied barrier to creating a multilingual and diverse STEM workforce. 
    more » « less