Proceedings

Towards Anytime Retrieval: A Benchmark for Anytime Person Re-Identification

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 1467-1475.

https://doi.org/10.24963/ijcai.2025/164

Abstract

In real applications, person re-identification (ReID) expects to retrieve the target person at any time, including both daytime and nighttime, ranging from short-term to long-term. However, existing ReID tasks and datasets cannot meet this requirement, as they are constrained by available time and only provide training and evaluation for specific scenarios. Therefore, we investigate a new task called Anytime Person Re-identification (AT-ReID), which aims to achieve effective retrieval in multiple scenarios based on variations in time. To address the AT-ReID problem, we collect the first large-scale dataset, AT-USTC, which contains 135k images of individuals wearing multiple clothes captured by RGB and IR cameras. Our data collection spans over an entire year and 270 volunteers were photographed on average 29.1 times across different dates or scenes, 4-15 times more than current datasets, providing conditions for follow-up investigations in AT-ReID. Further, to tackle the new challenge of multi-scenario retrieval, we propose a unified model named Uni-AT, which comprises a multi-scenario ReID (MS-ReID) framework for scenario-specific features learning, a Mixture-of-Attribute-Experts (MoAE) module to alleviate inter-scenario interference, and a Hierarchical Dynamic Weighting (HDW) strategy to ensure balanced training across all scenarios. Extensive experiments show that our model leads to satisfactory results and exhibits excellent generalization to all scenarios.

  1. MSMT17: 4.7 Capture Times/Videos Per Person A T -USTC: 29.1 LTCC: 7.3 SYSU-MM01: 4.6 Summer Spring Winter Market1501: 4.4 DeepChange: 4.7 LLCM: 3.2
  2. [Bao et al., 2022] Hangbo Bao, Wenhui Wang, Li Dong, Qiang Liu, Owais Khan Mohammed, Kriti Aggarwal, Sub- hojit Som, Songhao Piao, and Furu Wei. Vlmo: Unified vision-language pre-training with mixture-of-modality- experts. Advances in Neural Information Processing Sys- tems, 35:32897-32912, 2022.
  3. [Chen et al., 2021] Jiaxing Chen, Xinyang Jiang, Fudong Wang, Jun Zhang, Feng Zheng, Xing Sun, and Wei-Shi Zheng. Learning 3d shape feature for texture-insensitive person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8146-8155, 2021.
  4. [Chen et al., 2023] Cuiqun Chen, Mang Ye, and Ding Jiang. Towards modality-agnostic person re-identification with descriptive query. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 15128-15137, 2023.
  5. [Dosovitskiy et al., 2020] Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Min- derer, Georg Heigold, Sylvain Gelly, et al. An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929, 2020.
  6. [Fang et al., 2023] Xingye Fang, Yang Yang, and Ying Fu. Visible-infrared person re-identification via seman- tic alignment and affinity inference. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 11270-11279, 2023.
  7. [Feng et al., 2023] Jiawei Feng, Ancong Wu, and Wei-Shi Zheng. Shape-erased feature learning for visible-infrared person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 22752-22761, 2023.
  8. [Gu et al., 2022] Xinqian Gu, Hong Chang, Bingpeng Ma, Shutao Bai, Shiguang Shan, and Xilin Chen. Clothes- changing person re-identification with rgb modality only. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1060-1069, 2022.
  9. [Guo et al., 2018] Michelle Guo, Albert Haque, De-An Huang, Serena Yeung, and Li Fei-Fei. Dynamic task prior- itization for multitask learning. In Proceedings of the Eu- ropean Conference on Computer Vision, pages 270-287, 2018.
  10. [He et al., 2021] Shuting He, Hao Luo, Pichao Wang, Fan Wang, Hao Li, and Wei Jiang. Transreid: Transformer- based object re-identification. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 15013-15022, 2021.
  11. [Hendrycks and Gimpel, 2016] Dan Hendrycks and Kevin Gimpel. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415, 2016.
  12. [Jacobs et al., 1991] Robert A Jacobs, Michael I Jordan, Steven J Nowlan, and Geoffrey E Hinton. Adaptive mix- tures of local experts. Neural computation, 3(1):79-87, 1991.
  13. [Li et al., 2014] Wei Li, Rui Zhao, Tong Xiao, and Xiao- gang Wang. Deepreid: Deep filter pairing neural network for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 152-159, 2014.
  14. [Li et al., 2022] Xulin Li, Yan Lu, Bin Liu, Yating Liu, Guo- jun Yin, Qi Chu, Jinyang Huang, Feng Zhu, Rui Zhao, and Nenghai Yu. Counterfactual intervention feature trans- fer for visible-infrared person re-identification. In Pro- ceedings of the European Conference on Computer Vision, pages 381-398. Springer, 2022.
  15. [Li et al., 2023] Xulin Li, Yan Lu, Bin Liu, Yuenan Hou, Yating Liu, Qi Chu, Wanli Ouyang, and Nenghai Yu. Clothes-invariant feature learning by causal interven- tion for clothes-changing person re-identification. arXiv preprint arXiv:2305.06145, 2023.
  16. [Li et al., 2024] He Li, Mang Ye, Ming Zhang, and Bo Du. All in one framework for multimodal re-identification in the wild. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17459- 17469, 2024.
  17. [Lin et al., 2017] Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Dollár. Focal loss for dense ob- ject detection. In Proceedings of the IEEE International Conference on Computer Vision, pages 2980-2988, 2017.
  18. [Liu et al., 2021] Liyang Liu, Yi Li, Zhanghui Kuang, J Xue, Yimin Chen, Wenming Yang, Qingmin Liao, and Wayne Zhang. Towards impartial multi-task learning. iclr, 2021.
  19. [Liu et al., 2023] Fangyi Liu, Mang Ye, and Bo Du. Dual level adaptive weighting for cloth-changing person re- identification. IEEE Transactions on Image Processing, 2023.
  20. [Lu et al., 2020] Yan Lu, Yue Wu, Bin Liu, Tianzhu Zhang, Baopu Li, Qi Chu, and Nenghai Yu. Cross-modality person re-identification with shared-specific feature trans- fer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 13379- 13389, 2020.
  21. [Luo et al., 2019] Hao Luo, Youzhi Gu, Xingyu Liao, Shenqi Lai, and Wei Jiang. Bag of tricks and a strong baseline for deep person re-identification. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pat- tern Recognition Workshops, pages 0-0, 2019.
  22. [Ma et al., 2018] Jiaqi Ma, Zhe Zhao, Xinyang Yi, Jilin Chen, Lichan Hong, and Ed H Chi. Modeling task rela- tionships in multi-task learning with multi-gate mixture- of-experts. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, pages 1930-1939, 2018.
  23. [Ma et al., 2019] Jiaqi Ma, Zhe Zhao, Jilin Chen, Ang Li, Lichan Hong, and Ed H Chi. Snr: Sub-network routing for flexible parameter sharing in multi-task learning. In Proceedings of the AAAI Conference on Artificial Intelli- gence, volume 33, pages 216-223, 2019.
  24. [Meyerson and Miikkulainen, 2017] Elliot Meyerson and Risto Miikkulainen. Beyond shared hierarchies: Deep multitask learning through soft layer ordering. arXiv preprint arXiv:1711.00108, 2017.
  25. [Nguyen et al., 2017] Dat Tien Nguyen, Hyung Gil Hong, Ki Wan Kim, and Kang Ryoung Park. Person recognition system based on a combination of body images from visi- ble light and thermal cameras. Sensors, 17(3):605, 2017.
  26. [Qian et al., 2020] Xuelin Qian, Wenxuan Wang, Li Zhang, Fangrui Zhu, Yanwei Fu, Tao Xiang, Yu-Gang Jiang, and Xiangyang Xue. Long-term cloth-changing person re- identification. In Proceedings of the Asian Conference on Computer Vision, 2020.
  27. [Shu et al., 2021] Xiujun Shu, Xiao Wang, Xianghao Zang, Shiliang Zhang, Yuanqi Chen, Ge Li, and Qi Tian. Large- scale spatio-temporal person re-identification: Algorithms and benchmark. IEEE Transactions on Circuits and Sys- tems for Video Technology, 32(7):4390-4403, 2021.
  28. [Sun et al., 2018] Yifan Sun, Liang Zheng, Yi Yang, Qi Tian, and Shengjin Wang. Beyond part models: Person retrieval with refined part pooling (and a strong convolutional base- line). In Proceedings of the European Conference on Com- puter Vision, pages 480-496, 2018.
  29. [Sun et al., 2020] Yifan Sun, Changmao Cheng, Yuhan Zhang, Chi Zhang, Liang Zheng, Zhongdao Wang, and Yichen Wei. Circle loss: A unified perspective of pair similarity optimization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6398-6407, 2020.
  30. [Tang et al., 2020] Hongyan Tang, Junning Liu, Ming Zhao, and Xudong Gong. Progressive layered extraction (ple): A novel multi-task learning (mtl) model for personalized recommendations. In Proceedings of the 14th ACM Con- ference on Recommender Systems, pages 269-278, 2020.
  31. [Tang et al., 2023] Shixiang Tang, Cheng Chen, Qingsong Xie, Meilin Chen, Yizhou Wang, Yuanzheng Ci, Lei Bai, Feng Zhu, Haiyang Yang, Li Yi, et al. Humanbench: Towards general human-centric perception with projec- tor assisted pretraining. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21970-21982, 2023.
  32. [Wang et al., 2023] Zhen Wang, Rameswar Panda, Leonid Karlinsky, Rogerio Feris, Huan Sun, and Yoon Kim. Mul- titask prompt tuning enables parameter-efficient transfer learning. arXiv preprint arXiv:2303.02861, 2023.
  33. [Wei et al., 2018] Longhui Wei, Shiliang Zhang, Wen Gao, and Qi Tian. Person transfer gan to bridge domain gap for person re-identification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 79-88, 2018.
  34. [Wu et al., 2017] Ancong Wu, Wei-Shi Zheng, Hong-Xing Yu, Shaogang Gong, and Jianhuang Lai. Rgb-infrared cross-modality person re-identification. In Proceedings of the IEEE International Conference on Computer Vision, pages 5380-5389, 2017.
  35. [Xu and Zhu, 2023] Peng Xu and Xiatian Zhu. Deepchange: A long-term person re-identification benchmark with clothes change. In Proceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 11196- 11205, 2023.
  36. [Yang et al., 2019] Qize Yang, Ancong Wu, and Wei-Shi Zheng. Person re-identification by contour sketch under moderate clothing change. IEEE Transactions on Pat- tern Analysis and Machine Intelligence, 43(6):2029-2046, 2019.
  37. [Yang et al., 2023a] Bin Yang, Jun Chen, and Mang Ye. To- wards grand unified representation learning for unsuper- vised visible-infrared person re-identification. In Proceed- ings of the IEEE/CVF International Conference on Com- puter Vision, pages 11069-11079, 2023.
  38. [Yang et al., 2023b] Zhengwei Yang, Meng Lin, Xian Zhong, Yu Wu, and Zheng Wang. Good is bad: Causal- ity inspired cloth-debiasing for cloth-changing person re- identification. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 1472-1481, 2023.
  39. [Ye et al., 2021] Mang Ye, Jianbing Shen, Gaojie Lin, Tao Xiang, Ling Shao, and Steven CH Hoi. Deep learn- ing for person re-identification: A survey and outlook. IEEE Transactions on Pattern Analysis and Machine In- telligence, 2021.
  40. [Yıldız and Kasım, 2024] Serdar Yıldız and Ahmet Nezih Kasım. Entire-id: An extensive and diverse dataset for person re-identification. In 2024 IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG), pages 1-5. IEEE, 2024.
  41. [Zhang and Wang, 2023] Yukang Zhang and Hanzi Wang. Diverse embedding expansion network and low-light cross-modality benchmark for visible-infrared person re- identification. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition, pages 2153-2162, 2023.
  42. [Zheng et al., 2015] Liang Zheng, Liyue Shen, Lu Tian, Shengjin Wang, Jingdong Wang, and Qi Tian. Scalable person re-identification: A benchmark. In Proceedings of the IEEE International Conference on Computer Vision, pages 1116-1124, 2015.
  43. [Zhong et al., 2020] Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. Random erasing data aug- mentation. In Proceedings of the AAAI conference on arti- ficial intelligence, volume 34, pages 13001-13008, 2020.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards