Background As a number of vaccines for COVID-19 are given emergency use authorization by local health agencies and are being administered in multiple countries, it is crucial to gain public trust in these vaccines to ensure herd immunity through vaccination. One way to gauge public sentiment regarding vaccines for the goal of increasing vaccination rates is by analyzing social media such as Twitter. Objective The goal of this research was to understand public sentiment toward COVID-19 vaccines by analyzing discussions about the vaccines on social media for a period of 60 days when the vaccines were started in the United States. Using the combination of topic detection and sentiment analysis, we identified different types of concerns regarding vaccines that were expressed by different groups of the public on social media. Methods To better understand public sentiment, we collected tweets for exactly 60 days starting from December 16, 2020 that contained hashtags or keywords related to COVID-19 vaccines. We detected and analyzed different topics of discussion of these tweets as well as their emotional content. Vaccine topics were identified by nonnegative matrix factorization, and emotional content was identified using the Valence Aware Dictionary and sEntiment Reasoner sentiment analysis library as well as by using sentence bidirectional encoder representations from transformer embeddings and comparing the embedding to different emotions using cosine similarity. Results After removing all duplicates and retweets, 7,948,886 tweets were collected during the 60-day time period. Topic modeling resulted in 50 topics; of those, we selected 12 topics with the highest volume of tweets for analysis. Administration and access to vaccines were some of the major concerns of the public. Additionally, we classified the tweets in each topic into 1 of the 5 emotions and found fear to be the leading emotion in the tweets, followed by joy. Conclusions This research focused not only on negative emotions that may have led to vaccine hesitancy but also on positive emotions toward the vaccine. By identifying both positive and negative emotions, we were able to identify the public's response to the vaccines overall and to news events related to the vaccines. These results are useful for developing plans for disseminating authoritative health information and for better communication to build understanding and trust.
more »
« less
Mining Twitter to assess the determinants of health behavior toward human papillomavirus vaccination in the United States
The study sought to test the feasibility of using Twitter data to assess determinants of consumers’ health behavior toward human papillomavirus (HPV) vaccination informed by the Integrated Behavior Model (IBM).
We used 3 Twitter datasets spanning from 2014 to 2018. We preprocessed and geocoded the tweets, and then built a rule-based model that classified each tweet into either promotional information or consumers’ discussions. We applied topic modeling to discover major themes and subsequently explored the associations between the topics learned from consumers’ discussions and the responses of HPV-related questions in the Health Information National Trends Survey (HINTS).
We collected 2 846 495 tweets and analyzed 335 681 geocoded tweets. Through topic modeling, we identified 122 high-quality topics. The most discussed consumer topic is “cervical cancer screening”; while in promotional tweets, the most popular topic is to increase awareness of “HPV causes cancer.” A total of 87 of the 122 topics are correlated between promotional information and consumers’ discussions. Guided by IBM, we examined the alignment between our Twitter findings and the results obtained from HINTS. Thirty-five topics can be mapped to HINTS questions by keywords, 112 topics can be mapped to IBM constructs, and 45 topics have statistically significant correlations with HINTS responses in terms of geographic distributions.
Mining Twitter to assess consumers’ health behaviors can not only obtain results comparable to surveys, but also yield additional insights via a theory-driven approach. Limitations exist; nevertheless, these encouraging results impel us to develop innovative ways of leveraging social media in the changing health communication landscape.
- NSF-PAR ID:
- 10123749
- Publisher / Repository:
- Oxford University Press
- Date Published:
- Journal Name:
- Journal of the American Medical Informatics Association
- ISSN:
- 1527-974X
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
-
-
The objective of this paper is to propose and test a system analytics framework based on social sensing and text mining to detect topic evolution associated with the performance of infrastructure systems in disasters. Social media, like Twitter, as active channels of communication and information dissemination, provide insights into real-time information and first-hand experience from affected areas in mass emergencies. While the existing studies show the importance of social sensing in improving situational awareness and emergency response in disasters, the use of social sensing for detection and analysis of infrastructure systems and their resilience performance has been rather limited. This limitation is due to the lack of frameworks to model the events and topics (e.g., grid interruption and road closure) evolution associated with infrastructure systems (e.g., power, highway, airport, and oil) in times of disasters. The proposed framework detects infrastructure-related topics of the tweets posted in disasters and their evolutions by integrating searching relevant keywords, text lemmatization, Part-of-Speech (POS) tagging, TF-IDF vectorization, topic modeling by using Latent Dirichlet Allocation (LDA), and K-Means clustering. The application of the proposed framework was demonstrated in a study of infrastructure systems in Houston during Hurricane Harvey. In this case study, more than sixty thousand tweets were retrieved from 150-mile radius in Houston over 39 days. The analysis of topic detection and evolution from user-generated data were conducted, and the clusters of tweets pertaining to certain topics were mapped in networks over time. The results show that the proposed framework enables to summarize topics and track the movement of situations in different disaster phases. The analytics elements of the proposed framework can improve the recognition of infrastructure performance through text-based representation and provide evidence for decision-makers to take actionable measurements.more » « less
-
This study investigated the content of parenting information shared on social media by identifying the range and frequency of topics shared by parenting-focused accounts on Twitter. Using the Twitter API, a universe of 675,069 tweets were gathered from 74 of the most-followed parenting-focused accounts, or “hubs,” from January 2016 to June 2018. Using a custom, semi-automated topic modeling approach, we identified the topics – and subtopics within topics – parenting hubs shared with their followers and investigated whether any meaningful differences in topical focus existed between accounts targeting mothers versus fathers. Results indicate that over one third of tweets were about Parenting Behavior and nearly one quarter about Health, with Entertainment, School and Motherhood and Fatherhood generally as less tweeted topics. Mother-focused accounts tweeted more about Health than father-focused accounts, which tweeted more than others about Entertainment. Implications for future parenting and social media research are discussed.more » « less
-
Background Internet data can be used to improve infectious disease models. However, the representativeness and individual-level validity of internet-derived measures are largely unexplored as this requires ground truth data for study. Objective This study sought to identify relationships between Web-based behaviors and/or conversation topics and health status using a ground truth, survey-based dataset. Methods This study leveraged a unique dataset of self-reported surveys, microbiological laboratory tests, and social media data from the same individuals toward understanding the validity of individual-level constructs pertaining to influenza-like illness in social media data. Logistic regression models were used to identify illness in Twitter posts using user posting behaviors and topic model features extracted from users’ tweets. Results Of 396 original study participants, only 81 met the inclusion criteria for this study. Of these participants’ tweets, we identified only two instances that were related to health and occurred within 2 weeks (before or after) of a survey indicating symptoms. It was not possible to predict when participants reported symptoms using features derived from topic models (area under the curve [AUC]=0.51; P=.38), though it was possible using behavior features, albeit with a very small effect size (AUC=0.53; P≤.001). Individual symptoms were also generally not predictable either. The study sample and a random sample from Twitter are predictably different on held-out data (AUC=0.67; P≤.001), meaning that the content posted by people who participated in this study was predictably different from that posted by random Twitter users. Individuals in the random sample and the GoViral sample used Twitter with similar frequencies (similar @ mentions, number of tweets, and number of retweets; AUC=0.50; P=.19). Conclusions To our knowledge, this is the first instance of an attempt to use a ground truth dataset to validate infectious disease observations in social media data. The lack of signal, the lack of predictability among behaviors or topics, and the demonstrated volunteer bias in the study population are important findings for the large and growing body of disease surveillance using internet-sourced data.more » « less
-
more » « less
Background Stay-at-home orders were one of the controversial interventions to curb the spread of COVID-19 in the United States. The stay-at-home orders, implemented in 51 states and territories between March 7 and June 30, 2020, impacted the lives of individuals and communities and accelerated the heavy usage of web-based social networking sites. Twitter sentiment analysis can provide valuable insight into public health emergency response measures and allow for better formulation and timing of future public health measures to be released in response to future public health emergencies.
Objective This study evaluated how stay-at-home orders affect Twitter sentiment in the United States. Furthermore, this study aimed to understand the feedback on stay-at-home orders from groups with different circumstances and backgrounds. In addition, we particularly focused on vulnerable groups, including older people groups with underlying medical conditions, small and medium enterprises, and low-income groups.
Methods We constructed a multiperiod difference-in-differences regression model based on the Twitter sentiment geographical index quantified from 7.4 billion geo-tagged tweets data to analyze the dynamics of sentiment feedback on stay-at-home orders across the United States. In addition, we used moderated effects analysis to assess differential feedback from vulnerable groups.
Results We combed through the implementation of stay-at-home orders, Twitter sentiment geographical index, and the number of confirmed cases and deaths in 51 US states and territories. We identified trend changes in public sentiment before and after the stay-at-home orders. Regression results showed that stay-at-home orders generated a positive response, contributing to a recovery in Twitter sentiment. However, vulnerable groups faced greater shocks and hardships during the COVID-19 pandemic. In addition, economic and demographic characteristics had a significant moderating effect.
Conclusions This study showed a clear positive shift in public opinion about COVID-19, with this positive impact occurring primarily after stay-at-home orders. However, this positive sentiment is time-limited, with 14 days later allowing people to be more influenced by the status quo and trends, so feedback on the stay-at-home orders is no longer positively significant. In particular, negative sentiment is more likely to be generated in states with a large proportion of vulnerable groups, and the policy plays a limited role. The pandemic hit older people, those with underlying diseases, and small and medium enterprises directly but hurt states with cross-cutting economic situations and more complex demographics over time. Based on large-scale Twitter data, this sociological perspective allows us to monitor the evolution of public opinion more directly, assess the impact of social events on public opinion, and understand the heterogeneity in the face of pandemic shocks.
