skip to main content
US FlagAn official website of the United States government
dot gov icon
Official websites use .gov
A .gov website belongs to an official government organization in the United States.
https lock icon
Secure .gov websites use HTTPS
A lock ( lock ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

Explore Research Products in the PAR
It may take a few hours for recently added research products to appear in PAR search results.


Title: Double-Checking History: Designing Assessable Systems for Historical Photo Identification
Identifying historical photographs of people can generate significant cultural and economic value, but misidentifications can cause harms such as falsifying the historical record, spreading disinformation, and feeding conspiracy theories. In this paper, we introduce DoubleCheck, a quality assessment framework based on the concepts of information provenance and stewardship for verifying historical photo identifications. We built and evaluated DoubleCheck on Civil War Photo Sleuth (CWPS), a popular online community dedicated to identifying photos from the American CivilWar era (1861- 65) using facial recognition and crowdsourcing.  more » « less
Award ID(s):
1651969 1527453
PAR ID:
10315696
Author(s) / Creator(s):
;
Date Published:
Journal Name:
AAAI HCOMP 2021 Demos
Format(s):
Medium: X
Sponsoring Org:
National Science Foundation
More Like this
  1. ; ; ; (, Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence Sister Conferences Best Papers)
    null (Ed.)
    Identifying people in historical photographs is important for interpreting material culture, correcting the historical record, and creating economic value, but it is also a complex and challenging task. In this paper, we focus on identifying portraits of soldiers who participated in the American Civil War (1861-65). Millions of these portraits survive, but only 10-20% are identified. We created Photo Sleuth, a web-based platform that combines crowdsourced human expertise and automated face recognition to support Civil War portrait identification. Our mixed-methods evaluation of Photo Sleuth one month after its public launch showed that it helped users successfully identify unknown portraits. 
    more » « less
  2. ; ; ; (, Proceedings of the 24th ACM Conference on Intelligent User Interfaces (IUI ’19))
    Identifying people in historical photographs is important for preserving material culture, correcting the historical record, and creating economic value, but it is also a complex and challenging task. In this paper, we focus on identifying portraits of soldiers who participated in the American Civil War (1861-65), the first widely-photographed conflict. Many thousands of these portraits survive, but only 10--20% are identified. We created Photo Sleuth, a web-based platform that combines crowdsourced human expertise and automated face recognition to support Civil War portrait identification. Our mixed-methods evaluation of Photo Sleuth one month after its public launch showed that it helped users successfully identify unknown portraits and provided a sustainable model for volunteer contribution. We also discuss implications for crowd-AI interaction and person identification pipelines. 
    more » « less
  3. ; ; (, CSCW '21: Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing)
    Identifying people in photographs is an important task in many fields, including history, journalism, genealogy, and collecting, but accurate person identification remains challenging. Researchers especially struggle with the “last-mile problem” of historical person identification, where they must make a selection among a small number of highly similar candidates. We present SleuthTalk, a web-based collaboration tool integrated into the public website Civil War Photo Sleuth which addresses the last-mile problem in historical person identification by providing support for shortlisting potential candidates from face recognition results, private collaborative workspaces, and structured feedback. 
    more » « less
  4. ; ; ; ; ; ; ; ; ; ; et al (, Frontiers in Ecology and Evolution)
    Leopard seals have traditionally been considered Antarctic predators with a Southern Ocean distribution. Historically, sightings north of the Antarctic Polar Front were considered extralimital. However, recent studies suggest a significant presence of leopard seals in subantarctic regions. Here, we assess the spatial occurrence, residency status, and temporal trends of leopard seals in Chile using historical records, stranding reports, standardized monitoring data, photo-identification (photo ID) catalogs, and sightings from four research expeditions. We also characterize glaciers where sightings are concentrated, identifying glaciological and geomorphic attributes that prolong iceberg residency time, which is linked to high leopard seal concentrations. Based on these attributes, we evaluated other potential suitable glacial habitats in Patagonia. We obtained 438 sighting records of leopard seals from 1927 to 2023. Over the last 15 years, we documented a 4-18% annual increase in stranding events reported to national authorities. Most sightings (75%) were concentrated in two hotspots: National Park San Rafael Lagoon, located in Northern Patagonia, and Parry Fjord in Tierra del Fuego. Using photo ID catalogs, we identified 19 resident leopard seals, including 16 multi-year residents observed between 2010-2023 (10 in San Rafael, 6 in Tierra del Fuego) and 3 potential residents (observed multiple months in the same year in Tierra del Fuego). San Rafael monitoring data showed no inter-annual trend, but seasonal trends were observed. We also provide evidence of breeding in Chile, with records of at least 14 pups born and at least two females giving birth in multiple years. Our habitat characterization suggests that calving flux, fjord sinuosity, and fjord width variation are crucial for prolonging iceberg residency in hotspot areas. Based on these attributes, we identified 13 additional fjords in Patagonia as “very likely” suitable for leopard seals. Our study confirms that Patagonia is part of the species’ breeding distribution, shifting the paradigm that leopard seals are merely visitors north of the Antarctic Polar Front. Given the limited number of suitable glaciers in Chile and the potential impacts of climate change, our assessment highlights glacial retreat as a major threat for the ecosystem of this pagophilic marine apex predator in South America. 
    more » « less
  5. ; ; ; ; ; (, Proceedings of the AAAI Conference on Artificial Intelligence)
    Hashtags can greatly facilitate content navigation and improve user engagement in social media. Meaningful as it might be, recommending hashtags for photo sharing services such as Instagram and Pinterest remains a daunting task due to the following two reasons. On the endogenous side, posts in photo sharing services often contain both images and text, which are likely to be correlated with each other. Therefore, it is crucial to coherently model both image and text as well as the interaction between them. On the exogenous side, hashtags are generated by users and different users might come up with different tags for similar posts, due to their different preference and/or community effect. Therefore, it is highly desirable to characterize the users’ tagging habits. In this paper, we propose an integral and effective hashtag recommendation approach for photo sharing services. In particular, the proposed approach considers both the endogenous and exogenous effects by a content modeling module and a habit modeling module, respectively. For the content modeling module, we adopt the parallel co-attention mechanism to coherently model both image and text as well as the interaction between them; for the habit modeling module, we introduce an external memory unit to characterize the historical tagging habit of each user. The overall hashtag recommendations are generated on the basis of both the post features from the content modeling module and the habit influences from the habit modeling module. We evaluate the proposed approach on real Instagram data. The experimental results demonstrate that the proposed approach significantly outperforms the state-of-theart methods in terms of recommendation accuracy, and that both content modeling and habit modeling contribute significantly to the overall recommendation accuracy. 
    more » « less
  • Citation Formats
  • MLA
  • APA
  • Chicago
  • BibTeX
  • Save / Share this Record
  • Send to Email