skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Timely, Granular, and Actionable: Designing a Social Listening Platform for Public Health 3.0
Every day patients access and generate online health content through a variety of online channels, creating an ever-expanding sea of data in the form of digital communications. At the same time, proponents of public health have recently called for timely, granular, and actionable data to address a range of public health issues, stressing the need for social listening platforms that can identify and compile this valuable data. Yet previous attempts at social listening in healthcare have yielded mixed results, largely because they have failed to incorporate sufficient context to understand the communications they seek to analyze. Guided by Activity Theory to design HealthSense, we propose a platform for efficiently sensing and gathering data across the web for real time analysis to support public health outcomes. HealthSense couples theory-guided content analysis and graph propagation with graph neural networks (GNNs) to assess the relevance and credibility of information, as well as intelligently navigate the complex online channel landscape, leading to significant improvements over existing social listening tools. We demonstrate the value of our artifact in gathering information to support two important exemplar public health tasks: 1) performing post market drug surveillance for adverse reactions and 2) addressing the opioid crisis by monitoring for potent synthetic opioids released into communities. Our results across data, user, and event experiments show that effective design artifacts can enable better outcomes across both automated and human decision-making contexts, making social listening for public health possible, practical, and valuable. Through our design process, we extend Activity Theory to address the complexities of modern online communication platforms, where information resides not only within the collection of individual communication activities, but in the complex network of interactions between them.  more » « less
Award ID(s):
2039915
PAR ID:
10482736
Author(s) / Creator(s):
; ;
Publisher / Repository:
Association for Computing Machinery (ACM)
Date Published:
Journal Name:
Management information systems quarterly
ISSN:
0276-7783
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The public interest in accurate scientific communication, underscored by recent public health crises, highlights how content often loses critical pieces of information as it spreads online. However, multi-platform analyses of this phenomenon remain limited due to challenges in data collection. Collecting mentions of research tracked by Altmetric LLC, we examine information retention in over 4 million online posts referencing 9,765 of the most-mentioned scientific articles across blog sites, Facebook, news sites, Twitter, and Wikipedia. To do so, we present a burst-based framework for examining online discussions about science over time and across different platforms. To measure information retention, we develop a keyword-based computational measure comparing an online post to the scientific article’s abstract. We evaluate our measure using ground truth data labeled by within-field experts. We highlight three main findings: first, we find a strong tendency towards low levels of information retention, following a distinct trajectory of loss except when bursts of attention begin on social media. Second, platforms show significant differences in information retention. Third, sequences involving more platforms tend to be associated with higher information retention. These findings highlight a strong tendency towards information loss over time—posing a critical concern for researchers, policymakers, and citizens alike—but suggest that multi-platform discussions may improve information retention overall. 
    more » « less
  2. The way media portray public health problems influences the public’s perception of problems and related solutions. Social media allows users to engage with news and to collectively construct meaning. This paper examined news in comparison to user-generated content related to opioids to understand the role of second-level agenda-setting in public health. We analyzed 162,760 tweets about the opioid crisis, and compared the main topics and their sentiments with 2998 opioid stories from The New York Times online. Evidence from this study suggests that second-level agenda setting on social media is different from the news; public communication about opioids on X/Twitter highlights attributes that are different from those highlighted in the news. The findings suggest that public health communication should strategically utilize social media data, including obtaining consumer insight from personal tweets, listening to diverse views and warning signs from issue tweets, and tuning in to the media for policy trends. 
    more » « less
  3. Lin, Yu-Ru; Cha, Meeyoung; Quercia, Daniele (Ed.)
    The public interest in accurate scientific communication, underscored by recent public health crises, highlights how content often loses critical pieces of information as it spreads on-line. However, multi-platform analyses of this phenomenon remain limited due to challenges in data collection. Collecting mentions of research tracked by Altmetric LLC, we examine information retention in the over 4 million online posts referencing 9,765 of the most-mentioned scientific articles across blog sites, Facebook, news sites, Twitter, and Wikipedia. To do so, we present a burst-based framework for examining online discussions about science over time and across different platforms. To measure information retention, we develop a keyword-based computational measure comparing an online post to the scientific article’s abstract. We evaluate our measure using ground truth data labeled by within field experts. We highlight three main findings: first, we find a strong tendency towards low levels of information retention, following a distinct trajectory of loss except when bursts of attention begin in social media. Second, platforms show significant differences in information retention. Third, sequences involving more platforms tend to be associated with higher information retention. These findings highlight a strong tendency towards information loss over time—posing a critical concern for researchers, policymakers, and citizens alike—but suggest that multi-platform discussions may im-prove information retention overall. 
    more » « less
  4. Online social communities are becoming windows for learning more about the health of populations, through information about our health-related behaviors and outcomes from daily life. At the same time, just as public health data and theory has shown that aspects of the built environment can affect our health-related behaviors and outcomes, it is also possible that online social environments (e.g., posts and other attributes of our online social networks) can also shape facets of our life. Given the important role of the online environment in public health research and implications, factors which contribute to the generation of such data must be well understood. Here we study the role of the built and online social environments in the expression of dining on Instagram in Abu Dhabi; a ubiquitous social media platform, city with a vibrant dining culture, and a topic (food posts) which has been studied in relation to public health outcomes. Our study uses available data on user Instagram profiles and their Instagram networks, as well as the local food environment measured through the dining types (e.g., casual dining restaurants, food court restaurants, lounges etc.) by neighborhood. We find evidence that factors of the online social environment (profiles that post about dining versus profiles that do not post about dining) have different influences on the relationship between a user’s built environment and the social dining expression, with effects also varying by dining types in the environment and time of day. We examine the mechanism of the relationships via moderation and mediation analyses. Overall, this study provides evidence that the interplay of online and built environments depend on attributes of said environments and can also vary by time of day. We discuss implications of this synergy for precisely-targeting public health interventions, as well as on using online data for public health research. 
    more » « less
  5. null (Ed.)
    During COVID-19, social media has played an important role for public health agencies and government stakeholders (i.e. actors) to disseminate information regarding situations, risks, and personal protective action inhibiting disease spread. However, there have been notable insufficient, incongruent, and inconsistent communications regarding the pandemic and its risks, which was especially salient at the early stages of the outbreak. Sufficiency, congruence and consistency in health risk communication have important implications for effective health safety instruction as well as critical content interpretability and recall. It also impacts individual- and community-level responses to information. This research employs text mining techniques and dynamic network analysis to investigate the actors’ risk and crisis communication on Twitter regarding message types, communication sufficiency, timeliness, congruence, consistency and coordination. We studied 13,598 pandemic-relevant tweets posted over January to April from 67 federal and state-level agencies and stakeholders in the U.S. The study annotates 16 categories of message types, analyzes their appearances and evolutions. The research then identifies inconsistencies and incongruencies on four critical topics and examines spatial disparities, timeliness, and sufficiency across actors and message types in communicating COVID-19. The network analysis also reveals increased communication coordination over time. The findings provide unprecedented insight of Twitter COVID-19 information dissemination which may help to inform public health agencies and governmental stakeholders future risk and crisis communication strategies related to global hazards in digital environments. 
    more » « less