skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Double-Checking History: Designing Assessable Systems for Historical Photo Identification
Identifying historical photographs of people can generate significant cultural and economic value, but misidentifications can cause harms such as falsifying the historical record, spreading disinformation, and feeding conspiracy theories. In this paper, we introduce DoubleCheck, a quality assessment framework based on the concepts of information provenance and stewardship for verifying historical photo identifications. We built and evaluated DoubleCheck on Civil War Photo Sleuth (CWPS), a popular online community dedicated to identifying photos from the American CivilWar era (1861- 65) using facial recognition and crowdsourcing.  more » « less
Award ID(s):
1651969 1527453
PAR ID:
10315696
Author(s) / Creator(s):
;
Date Published:
Journal Name:
AAAI HCOMP 2021 Demos
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence Sister Conferences Best Papers)
    null (Ed.)
    Identifying people in historical photographs is important for interpreting material culture, correcting the historical record, and creating economic value, but it is also a complex and challenging task. In this paper, we focus on identifying portraits of soldiers who participated in the American Civil War (1861-65). Millions of these portraits survive, but only 10-20% are identified. We created Photo Sleuth, a web-based platform that combines crowdsourced human expertise and automated face recognition to support Civil War portrait identification. Our mixed-methods evaluation of Photo Sleuth one month after its public launch showed that it helped users successfully identify unknown portraits. 
    more » « less
  2. ; ; ; (, Proceedings of the 24th ACM Conference on Intelligent User Interfaces (IUI ’19))
    Identifying people in historical photographs is important for preserving material culture, correcting the historical record, and creating economic value, but it is also a complex and challenging task. In this paper, we focus on identifying portraits of soldiers who participated in the American Civil War (1861-65), the first widely-photographed conflict. Many thousands of these portraits survive, but only 10--20% are identified. We created Photo Sleuth, a web-based platform that combines crowdsourced human expertise and automated face recognition to support Civil War portrait identification. Our mixed-methods evaluation of Photo Sleuth one month after its public launch showed that it helped users successfully identify unknown portraits and provided a sustainable model for volunteer contribution. We also discuss implications for crowd-AI interaction and person identification pipelines. 
    more » « less
  3. ; ; (, CSCW '21: Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing)
    Identifying people in photographs is an important task in many fields, including history, journalism, genealogy, and collecting, but accurate person identification remains challenging. Researchers especially struggle with the “last-mile problem” of historical person identification, where they must make a selection among a small number of highly similar candidates. We present SleuthTalk, a web-based collaboration tool integrated into the public website Civil War Photo Sleuth which addresses the last-mile problem in historical person identification by providing support for shortlisting potential candidates from face recognition results, private collaborative workspaces, and structured feedback. 
    more » « less
  4. ; ; ; ; ; (, Proceedings of the AAAI Conference on Artificial Intelligence)
    Hashtags can greatly facilitate content navigation and improve user engagement in social media. Meaningful as it might be, recommending hashtags for photo sharing services such as Instagram and Pinterest remains a daunting task due to the following two reasons. On the endogenous side, posts in photo sharing services often contain both images and text, which are likely to be correlated with each other. Therefore, it is crucial to coherently model both image and text as well as the interaction between them. On the exogenous side, hashtags are generated by users and different users might come up with different tags for similar posts, due to their different preference and/or community effect. Therefore, it is highly desirable to characterize the users’ tagging habits. In this paper, we propose an integral and effective hashtag recommendation approach for photo sharing services. In particular, the proposed approach considers both the endogenous and exogenous effects by a content modeling module and a habit modeling module, respectively. For the content modeling module, we adopt the parallel co-attention mechanism to coherently model both image and text as well as the interaction between them; for the habit modeling module, we introduce an external memory unit to characterize the historical tagging habit of each user. The overall hashtag recommendations are generated on the basis of both the post features from the content modeling module and the habit influences from the habit modeling module. We evaluate the proposed approach on real Instagram data. The experimental results demonstrate that the proposed approach significantly outperforms the state-of-theart methods in terms of recommendation accuracy, and that both content modeling and habit modeling contribute significantly to the overall recommendation accuracy. 
    more » « less
  5. ; ; ; ; ; ; (, Fish and Fisheries)
    Abstract Historical information has provided key insights into long‐term ecological change to marine species and ecosystems, with value to fisheries. Yet, pathways to integrate these diverse data sources into fisheries decision‐making have not been clear. Here, we identify an array of biological, ecological, and social information suitable for contemporary science‐based decision‐making, derived from local ecological knowledge, historical archives, archaeological middens and palaeoecological material. We outline two broad pathways to integrate these historical data into fisheries decision‐making, demonstrating that data‐driven use of historical information is relevant across a range of management contexts. First, historical information can inform fisheries assessments that range from simple to complex, affecting indicators of stock status. Second, it can inform estimates of biological potential and social preference, affecting the choice of fisheries reference points. Using the Caribbean Sea as an example, we illustrate these ideas with case studies representing diverse species and historical data types. Integrating historical data can improve indicators of the current state of fish populations and result in management decisions based on a more complete understanding of a potential range of variation, avoiding shifted baselines. The urgency of this work is underscored by accelerating environmental changes and the rapid loss of invaluable historical information sources. By illuminating pathways, our goal is to increase the accessibility of these types of information and to underscore that scientists, managers, and resource users have roles to play in identifying and integrating relevant long‐term data at various spatial and temporal scales to sustainably manage marine fisheries. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email