skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.


Title: Number Soup: Case Studies of Quantitatively Dense News
Numbers don’t speak for themselves – yet taking numbers for granted (numerism) is widespread. In fact, journalists often rely heavily on numbers precisely because they are widely considered objective. As a team of journalists and social scientists, we undertook a qualitative exploration of clauses and entire news reports that are particularly quantitatively dense. The dense clauses were often grammatically complex and assumed familiarity with sophisticated concepts. They were rarely associated with explanations of data collection methods. Meanwhile, the dense news reports were all about economy or health topics, chiefly brief updates on an ongoing event (e.g., stock market fluctuations; COVID-19 cases). We suggest that journalists can support public understanding by: * Providing more detail about research methods; * Writing shorter, clearer sentences; * Providing context behind statistics; * Being transparent about uncertainty; and * Indicating where consensus lies. We also encourage news organizations to consider structural changes like rethinking their relationship with newswires and working closely with statisticians.  more » « less
Award ID(s):
1906802
PAR ID:
10344473
Author(s) / Creator(s):
; ; ; ; ; ; ; ;
Date Published:
Journal Name:
Journalism Practice
ISSN:
1751-2786
Page Range / eLocation ID:
1 to 28
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. The limited information (data voids) on political topics relevant to underrepresented communities has facilitated the spread of disinformation. Independent journalists who combat disinformation in underrepresented communities have reported feeling overwhelmed because they lack the tools necessary to make sense of the information they monitor to address the data voids. In this paper, we present a system to identify and address political data voids within underrepresented communities. Armed with an interview study indicating that independent news media has the potential of addressing these data voids, we designed the intelligent system: Datavoidant. Datavoidant introduces a novel design space that focuses on providing independent journalists with a collective understanding of data voids to then facilitate generating content to cover the voids. We performed a user interface evaluation with independent news media journalists (N=22). Journalists reported that Datavoidant's features allowed them to more rapidly and easily have a sense of what was taking place in the information ecosystem to address the data voids; they also reported feeling more confident about the content they created and the unique perspectives they proposed to cover the voids. We finish by discussing how Datavoidant enables a new design space where individuals can collaboratively make sense of their information ecosystem, and can proactively devise strategies for uniquely contributing information to their ecosystem, and together prevent disinformation. 
    more » « less
  2. Because people are constantly confronted with numbers and mathematical concepts in the news, we have embarked on a project to create journalism that can support news users’ number skills. But doing so requires understanding (1) journalists’ ability to reason with numbers, (2) other adults’ ability to do so, and (3) the attributes and affordances of news. In this paper, we focus on the relationship between adults’ news habits and their quantitative reasoning skills. We collected data from a sample of 1,200 US adults, testing their ability to interpret statistical results and asking them to report their news habits. The assessment we developed differentiated the skills of adults in our sample and conformed to the theoretical and statistical assumption that such skills are normally distributed in the population overall. We also found that respondents could be clustered into six distinct groups on the basis of news repertoires (overall patterns of usage, including frequency of news use overall and choice of news outlets). As often assumed in the literature on quantitative reasoning, these news repertoires predicted quantitative reasoning skills better than the amount of quantification in the outlets, but they still predicted only a small fraction of the variance. These results may suggest that news habits may play a smaller or less direct role in quantitative reasoning than has previously been assumed. We speculate that the presence (or absence) of quantification in everyday activities – namely work and hobbies – may be a better predictor of adults’ quantitative reasoning, as may additional dimensions of news habits and affective responses to numbers. 
    more » « less
  3. As news organizations embrace transparency practices on their websites to distinguish themselves from those spreading misinformation, HCI designers have the opportunity to help them effectively utilize the ideals of transparency to build trust. How can we utilize transparency to promote trust in news? We examine this question through a qualitative lens by interviewing journalists and news consumers---the two stakeholders in a news system. We designed a scenario to demonstrate transparency features using two fundamental news attributes that convey the trustworthiness of a news article: source and message. In the interviews, our news consumers expressed the idea that news transparency could be best shown by providing indicators of objectivity in two areas (news selection and framing) and by providing indicators of evidence in four areas (presence of source materials, anonymous sourcing, verification, and corrections upon erroneous reporting). While our journalists agreed with news consumers' suggestions of using evidence indicators, they also suggested additional transparency indicators in areas such as the news reporting process and personal/organizational conflicts of interest. Prompted by our scenario, participants offered new design considerations for building trustworthy news platforms, such as designing for easy comprehension, presenting appropriate details in news articles (e.g., showing the number and nature of corrections made to an article), and comparing attributes across news organizations to highlight diverging practices. Comparing the responses from our two stakeholder groups reveals conflicting suggestions with trade-offs between them. Our study has implications for HCI designers in building trustworthy news systems. 
    more » « less
  4. The news arguably serves to inform the quantitative reasoning (QR) of news audiences. Before one can contemplate how well the news serves this function, we first need to determine how much QR typical news stories require from readers. This paper assesses the amount of quantitative content present in a wide array of media sources, and the types of QR required for audiences to make sense of the information presented. We build a corpus of 230 US news reports across four topic areas (health, science, economy, and politics) in February 2020. After classifying reports for QR required at both the conceptual and phrase levels, we find that the news stories in our sample can largely be classified along a single dimension: The amount of quantitative information they contain. There were two main types of quantitative clauses: those reporting on magnitude and those reporting on comparisons. While economy and health reporting required significantly more QR than science or politics reporting, we could not reliably differentiate the topic area based on story-level requirements for quantitative knowledge and clause-level quantitative content. Instead, we find three reliable clusters of stories based on the amounts and types of quantitative information in the news stories. 
    more » « less
  5. Social media platforms have increasingly become an important way for news organizations to distribute content to their audiences. As news organizations relinquish control over distribution, they may feel the need to optimize their content to align with platform logics to ensure economic sustainability. However, the opaque and often proprietary nature of platform algorithms makes it hard for news organizations to truly know what kinds of content are preferred and will perform well. Invoking the concept of algorithmic ‘folk theories,’ this article presents a study of in-depth, semi-structured interviews with 18 U.S.-based news journalists and editors to understand how they make sense of social media algorithms, and to what extent this influences editorial decision making. Our findings suggest that while journalists’ understandings of platform algorithms create new considerations for gatekeeping practices, the extent to which it influences those practices is often negotiated against traditional journalistic conceptions of newsworthiness and journalistic autonomy. 
    more » « less