skip to main content


Title: Crowdsourcing to analyze belief systems underlying social issues
People’s beliefs and attitudes about social and scientific issues, such as capital punishment and climate change, appear to form complex but generally coherent networks. Understanding the nature of these networks is a prerequisite for designing interventions for changing beliefs on the basis of rational arguments and evidence. It is therefore important to develop methods to represent and analyze the form and nature of belief networks, which may not be explicitly verbalizable. Adopting an emerging approach that utilizes crowdsourcing to develop educational interventions, we mined discussions from the Reddit forum Change My View to determine which beliefs and types of information underlie people’s attitudes about capital punishment. By combining computational analyses based on a topic model with more qualitative assessments of the extracted topics, we found that moral arguments are more prevalent than statistical or data-based arguments. The present study serves as a test case for the open sourced software crowdpy, a Python toolkit for running naturalistic studies on the web, which will enable other researchers to use crowdsourcing in their research. This approach sets the stage for research exploring potential interventions to change people’s beliefs.  more » « less
Award ID(s):
1827374
NSF-PAR ID:
10157636
Author(s) / Creator(s):
;
Date Published:
Journal Name:
Proceedings of the Annual Conference of the Cognitive Science Society
ISSN:
1069-7977
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. Background Social networks such as Twitter offer the clinical research community a novel opportunity for engaging potential study participants based on user activity data. However, the availability of public social media data has led to new ethical challenges about respecting user privacy and the appropriateness of monitoring social media for clinical trial recruitment. Researchers have voiced the need for involving users’ perspectives in the development of ethical norms and regulations. Objective This study examined the attitudes and level of concern among Twitter users and nonusers about using Twitter for monitoring social media users and their conversations to recruit potential clinical trial participants. Methods We used two online methods for recruiting study participants: the open survey was (1) advertised on Twitter between May 23 and June 8, 2017, and (2) deployed on TurkPrime, a crowdsourcing data acquisition platform, between May 23 and June 8, 2017. Eligible participants were adults, 18 years of age or older, who lived in the United States. People with and without Twitter accounts were included in the study. Results While nearly half the respondents—on Twitter (94/603, 15.6%) and on TurkPrime (509/603, 84.4%)—indicated agreement that social media monitoring constitutes a form of eavesdropping that invades their privacy, over one-third disagreed and nearly 1 in 5 had no opinion. A chi-square test revealed a positive relationship between respondents’ general privacy concern and their average concern about Internet research (P<.005). We found associations between respondents’ Twitter literacy and their concerns about the ability for researchers to monitor their Twitter activity for clinical trial recruitment (P=.001) and whether they consider Twitter monitoring for clinical trial recruitment as eavesdropping (P<.001) and an invasion of privacy (P=.003). As Twitter literacy increased, so did people’s concerns about researchers monitoring Twitter activity. Our data support the previously suggested use of the nonexceptionalist methodology for assessing social media in research, insofar as social media-based recruitment does not need to be considered exceptional and, for most, it is considered preferable to traditional in-person interventions at physical clinics. The expressed attitudes were highly contextual, depending on factors such as the type of disease or health topic (eg, HIV/AIDS vs obesity vs smoking), the entity or person monitoring users on Twitter, and the monitored information. Conclusions The data and findings from this study contribute to the critical dialogue with the public about the use of social media in clinical research. The findings suggest that most users do not think that monitoring Twitter for clinical trial recruitment constitutes inappropriate surveillance or a violation of privacy. However, researchers should remain mindful that some participants might find social media monitoring problematic when connected with certain conditions or health topics. Further research should isolate factors that influence the level of concern among social media users across platforms and populations and inform the development of more clear and consistent guidelines. 
    more » « less
  2. Funded by the National Science Foundation (NSF) Racial Equity in STEM Education Program, this project aims to deeply interrogate the influence and pervasiveness of Whiteness in engineering culture. While there has been substantial research into the masculinity of engineering, Whiteness has received far less attention. We claim the centrality of Whiteness in engineering curricula informs the culture, climate, and discourse of engineering education, leading to an exclusionary culture within engineering as reflected by the lack of diversity and lower retention of students and faculty of color, and contributes to systemic barriers negatively impacting racial equity. Moving towards racial equity in engineering education requires a fundamental shift in thinking in two important ways: 1) we must reframe how we think about underserved populations from minority to minoritized by a dominant discourse, and 2) to begin to dismantle the impacts of Whiteness, we must first make this barrier visible. In the first year of this project, the diverse team of PIs began to explore scripts of Whiteness in engineering education by conducting a collaborative autoethnography through documenting and analyzing their own experiences facing, enacting, and challenging scripts of Whiteness in engineering spaces. A collaborative autoethnography (CAE) takes a collaborative approach to the process of critical self reflection and can be conducted in many forms, such as such as collecting personal memory data (e.g., journaling), interviewing each other, facilitating intentional dialogue, or observing each other (e.g., in the classroom). CAE is not a linear process, but requires an ongoing dialogue (conversations, negotiations, or even arguments) between researcher team members over a long period (at least months, if not years). Our diverse viewpoints and years-long experience working together facilitated rich conversations that let us interrogate the ways in which Whiteness reveals its form differently depending on one’s positionality. In the later years of the project, we will create a faculty development program intended to help engineering faculty develop their critical consciousness and begin to decenter Whiteness from their ways of thinking and discourses (i.e., beliefs, attitudes, value systems, actions, etc.) so they can begin to critically think about promoting and enacting practices that move engineering education toward racial equity. Although the pathway to critical consciousness is not linear, it is a one-way street; once faculty begin to see the systemic barriers (such as those created by scripts of Whiteness) around them, there is no going back. In the long term, we hope to lay the groundwork for recognizing, interrogating, and eventually dismantling forces of systemic oppression in engineering higher education. 
    more » « less
  3.  
    more » « less
  4. null (Ed.)
    Strategic response options to the COVID-19 pandemic have been greatly influenced by predictive epidemiological models. Effects of non-pharmaceutical interventions (NPIs; such as mask wearing) unfortunately are based on an abundance of very large uncertainties around the extent to which the population adopts risk reducing behaviors. The effects of NPIs appear to have large heterogeneity across regions, subgroups, and individual mindsets and capabilities. We hypothesize that these uncertainties can be improved with higher-fidelity computational modeling of the social-psychological reactions of individuals, groups, and populations. We build up the ACT-R theory and Instance-Based Learning Theory to formulate psychologically valid agents and develop a framework that integrates multi-level cognitive and social simulation with information networks analysis, and epidemiological predictions. We present initial results from analyses of beliefs and sentiments about COVID-19 NPIs induced from online social media that can provide inputs to seed and validate cognitive agents. We present illustrations of cognitive model hypotheses about the dynamics of behavior change in response to intentions, attitudes, messaging, and source credibility. We present an example of social networks propagating attitude change in response to NPIs. 
    more » « less
  5. This interdisciplinary, inter-institutional research initiation project is motivated by the need to develop practical strategies for broadening the participation of African American students in engineering. The central objective of the project is to conduct a comparative study of the factors affecting the success and pathways to engineering careers of African American students at a Predominantly White Institution (PWI), the University of Toledo, and a Historically Black University (Alabama Agricultural and Mechanical University). Through this research we hope to gain insight into the factors affecting the social and academic well-being of students at PWIs and HBCUs from a psychological and anthropological perspective. For students from underrepresented groups in STEM at both HBCUs and PWIs it is generally recognized that social capital in the form of familial, peer and mentor support is critical to persistence in their major field of study. However, the role that embedded networks within student groups in general, and minority engineering affinity groups in particular, play in engineering students’ identity formation and academic success is not well understood. It is also not clear how other factors including institutional support and the attitudes and beliefs of faculty and staff toward underrepresented minority students affect the ability of these students to integrate into the social and academic systems at their institutions and how these factors influence the formation and development of their identities as engineers. Here we report on the role of membership in organizations for underrepresented minority engineering students such as the National Society of Black Engineers (NSBE) in contributing to the interlinking of personal and professional identities, and to the career pathways of African American students enrolled in PWI and HBCU, respectively. 
    more » « less