Supporting Historical Photo Identification with Face Recognition and Crowdsourced Human Expertise (Extended Abstract)

Mohanty, Vikram; Thames, David; Mehta, Sneha; Luther, Kurt

doi:10.24963/ijcai.2020/660

Supporting Historical Photo Identification with Face Recognition and Crowdsourced Human Expertise (Extended Abstract)

Vikram Mohanty, David Thames, Sneha Mehta, Kurt Luther

Video Download BibTeX Cite

Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence. Sister Conferences Best Papers. Pages 4755-4759.

https://doi.org/10.24963/ijcai.2020/660

Keywords

Computer Vision: Biometrics, Face and Gesture Recognition
Humans and AI: Human-Computer Interaction
Humans and AI: Human-AI Collaboration
Humans and AI: Human Computation and Crowdsourcing

Abstract

Identifying people in historical photographs is important for interpreting material culture, correcting the historical record, and creating economic value, but it is also a complex and challenging task. In this paper, we focus on identifying portraits of soldiers who participated in the American Civil War (1861-65). Millions of these portraits survive, but only 10-20% are identified. We created Photo Sleuth, a web-based platform that combines crowdsourced human expertise and automated face recognition to support Civil War portrait identification. Our mixed-methods evaluation of Photo Sleuth one month after its public launch showed that it helped users successfully identify unknown portraits.

Vikram Mohanty, David Thames, Sneha Mehta, and Kurt Luther. 2020. Supporting Historical Photo Identification with Face Recognition and Crowdsourced Human Expertise (Extended Abstract). In Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20. IJCAI, 4755–4759. https://doi.org/10.24963/ijcai.2020/660

@inproceedings{ijcai2020p660,
  title     = {Supporting Historical Photo Identification with Face Recognition and Crowdsourced Human Expertise (Extended Abstract)},
  author    = {Mohanty, Vikram and Thames, David and Mehta, Sneha and Luther, Kurt},
  booktitle = {Proceedings of the Twenty-Ninth International Joint Conference on
               Artificial Intelligence, {IJCAI-20}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},
  editor    = {Christian Bessiere},
  pages     = {4755--4759},
  year      = {2020},
  month     = {7},
  note      = {Sister Conferences Best Papers},
  doi       = {10.24963/ijcai.2020/660},
  url       = {https://doi.org/10.24963/ijcai.2020/660},
}

TY  - CPAPER
TI  - Supporting Historical Photo Identification with Face Recognition and Crowdsourced Human Expertise (Extended Abstract)
AU  - Mohanty, Vikram
AU  - Thames, David
AU  - Mehta, Sneha
AU  - Luther, Kurt
T2  - Proceedings of the Twenty-Ninth International Joint Conference on Artificial Intelligence, IJCAI-20
PB  - International Joint Conferences on Artificial Intelligence Organization
PY  - 2020
SP  - 4755
EP  - 4759
DO  - 10.24963/ijcai.2020/660
UR  - https://doi.org/10.24963/ijcai.2020/660
ER  -