Proceedings

Dual-level Fuzzy Learning with Patch Guidance for Image Ordinal Regression

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Main Track. Pages 918-926.

https://doi.org/10.24963/ijcai.2025/103

Abstract

Ordinal regression bridges regression and classification by assigning objects to ordered classes. While human experts rely on discriminative patch-level features for decisions, current approaches are limited by the availability of only image-level ordinal labels, overlooking fine-grained patch-level characteristics. In this paper, we propose a Dual-level Fuzzy Learning with Patch Guidance framework, named DFPG that learns precise feature-based grading boundaries from ambiguous ordinal labels, with patch-level supervision. Specifically, we propose patch-labeling and filtering strategies to enable the model to focus on patch-level features exclusively with only image-level ordinal labels available. We further design a dual-level fuzzy learning module, which leverages fuzzy logic to quantitatively capture and handle label ambiguity from both patch-wise and channel-wise perspectives. Extensive experiments on various image ordinal regression datasets demonstrate the superiority of our proposed method, further confirming its ability in distinguishing samples from difficult-to-classify categories. The code is available at https://github.com/ZJUMAI/DFPG-ord.

  1. [Arpit et al., 2017] Devansh Arpit, Stanisław Jastrzunde- finedbski, Nicolas Ballas, David Krueger, Emmanuel Ben- gio, Maxinder S. Kanwal, Tegan Maharaj, Asja Fischer, Aaron Courville, Yoshua Bengio, and Simon Lacoste- Julien. A closer look at memorization in deep networks. In Proceedings of the 34th International Conference on Machine Learning -Volume 70, ICML'17, page 233-242. JMLR.org, 2017.
  2. [Chang et al., 2020] Jie Chang, Zhonghao Lan, Changmao Cheng, and Yichen Wei. Data uncertainty learning in face recognition. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5709-5718, 2020.
  3. [Chen et al., 2017] Shixing Chen, Caojin Zhang, Ming Dong, Jialiang Le, and Mike Rao. Using ranking-CNN for age estimation. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 742-751, 2017.
  4. [Cheng et al., 2023] Yi Cheng, Haochao Ying, Renjun Hu, Jinhong Wang, Wenhao Zheng, Xiao Zhang, Danny Chen, and Jian Wu. Robust image ordinal regression with con- trollable image generation. In Proceedings of the Thirty- Second International Joint Conference on Artificial Intel- ligence, IJCAI '23, 2023. IJCAI
  5. [Du et al., 2025] Yao Du, Qiang Zhai, Weihang Dai, and Xi- aomeng Li. Teach clip to develop a number sense for ordi- nal regression. In Aleš Leonardis, Elisa Ricci, Stefan Roth, Olga Russakovsky, Torsten Sattler, and Gül Varol, editors, Computer Vision -ECCV 2024, pages 1-17, Cham, 2025. Springer Nature Switzerland.
  6. [Díaz and Marathe, 2019] Raúl Díaz and Amit Marathe. Soft labels for ordinal regression. In 2019 IEEE/CVF Con- ference on Computer Vision and Pattern Recognition (CVPR), pages 4733-4742, 2019.
  7. [Frank and Hall, 2001] Eibe Frank and Mark Hall. A sim- ple approach to ordinal classification. In Proceedings of the 12th European Conference on Machine Learn- ing, ECML'01, page 145-156, Berlin, Heidelberg, 2001. Springer-Verlag.
  8. [Gao et al., 2017a] Bin-Bin Gao, Chao Xing, Chen-Wei Xie, Jianxin Wu, and Xin Geng. Deep label distribution learn- ing with label ambiguity. IEEE Transactions on Image Processing, 26(6):2825-2838, 2017.
  9. [Gao et al., 2017b] Bin-Bin Gao, Chao Xing, Chen-Wei Xie, Jianxin Wu, and Xin Geng. Deep label distribution learn- ing with label ambiguity. IEEE Transactions on Image Processing, 26(6):2825-2838, 2017.
  10. [Geng, 2016] Xin Geng. Label distribution learning. IEEE Transactions on Knowledge and Data Engineering, 28(7):1734-1748, 2016.
  11. [Ikram et al., 2024] Amna Ikram, Azhar Imran, Jianqiang Li, Abdulaziz Alzubaidi, Safa Fahim, Amanullah Yasin, and Hanaa Fathi. A systematic review on fundus image- based diabetic retinopathy detection and grading: Cur- rent status and future directions. IEEE Access, 12:96273- 96303, 2024.
  12. [Jiang et al., 2021] Zi-Hang Jiang, Qibin Hou, Li Yuan, Daquan Zhou, Yujun Shi, Xiaojie Jin, Anran Wang, and Jiashi Feng. All tokens matter: Token labeling for training better vision Transformers. In M. Ranzato, A. Beygelz- imer, Y. Dauphin, P.S. Liang, and J. Wortman Vaughan, editors, Advances in Neural Information Processing Sys- tems, volume 34, pages 18590-18602.
  13. Curran Associates, Inc., 2021.
  14. [Kingma and Ba, 2015] Diederik P. Kingma and Jimmy Ba. Adam: A method for stochastic optimization. In ICLR (Poster), 2015.
  15. [Kong et al., 2016] Shu Kong, Xiaohui Shen, Zhe Lin, Radomir Mech, and Charless Fowlkes. Photo aesthetics ranking network with attributes and content adaptation. In Bastian Leibe, Jiri Matas, Nicu Sebe, and Max Welling, editors, Computer Vision -ECCV 2016, pages 662-679, Cham, 2016. Springer International Publishing.
  16. [Lee and Kim, 2019] Jun-Tae Lee and Chang-Su Kim. Im- age aesthetic assessment based on pairwise comparison a unified approach to score regression, binary classification, and personalization. 2019 IEEE/CVF International Con- ference on Computer Vision (ICCV), pages 1191-1200, 2019.
  17. [Lee and Kim, 2021a] Seon-Ho Lee and Chang-Su Kim. Deep repulsive clustering of ordered data based on order- identity decomposition. In International Conference on Learning Representations, 2021.
  18. [Lee and Kim, 2021b] Seon-Ho Lee and Chang-Su Kim. Deep repulsive clustering of ordered data based on order- identity decomposition. In International Conference on Learning Representations, 2021.
  19. [Levi and Hassncer, 2015] Gil Levi and Tal Hassncer. Age and gender classification using convolutional neural net- works. In 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pages 34-42, 2015.
  20. [Li et al., 2019] Wanhua Li, Jiwen Lu, Jianjiang Feng, Chunjing Xu, Jie Zhou, and Qi Tian. BridgeNet: A continuity-aware probabilistic network for age estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2019.
  21. [Li et al., 2020] Junnan Li, Richard Socher, and Steven C.H. Hoi. DivideMix: Learning with noisy labels as semi- supervised learning. In International Conference on Learning Representations, 2020.
  22. [Li et al., 2021] Wanhua Li, Xiaoke Huang, Jiwen Lu, Jian- jiang Feng, and Jie Zhou. Learning probabilistic ordi- nal embeddings for uncertainty-aware regression. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 13891-13900, 2021.
  23. [Li et al., 2022] Wanhua Li, Xiaoke Huang, Zheng Zhu, Yansong Tang, Xiu Li, Jie Zhou, and Jiwen Lu. Ordi- nalclip: Learning rank prompts for language-guided or- dinal regression. In S. Koyejo, S. Mohamed, A. Agar- wal, D. Belgrave, K. Cho, and A. Oh, editors, Advances in Neural Information Processing Systems, volume 35, pages 35313-35325.
  24. Curran Associates, Inc., 2022.
  25. [Lim et al., 2020] Kyungsun Lim, Nyeong-Ho Shin, Young- Yoon Lee, and Chang-Su Kim. Order learning and its ap- plication to age estimation. In International Conference on Learning Representations, 2020.
  26. [Martin et al., 2014] Paul Martin, Antoine Doucet, and Frédéric Jurie. Dating color images with ordinal classi- fication. ICMR '14, page 447-450, New York, NY, USA, 2014. Association for Computing Machinery.
  27. [Niu et al., 2016] Zhenxing Niu, Mo Zhou, Le Wang, Xinbo Gao, and Gang Hua. Ordinal regression with multiple out- put CNN for age estimation. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 4920-4928, 2016.
  28. [Palmer et al., 2013] Stephen E. Palmer, Karen B. Schloss, and Jonathan Sammartino. Visual aesthetics and human preference. Annual Review of Psychology, 64(Volume 64, 2013):77-107, 2013.
  29. [Pan et al., 2018] Hongyu Pan, Hu Han, Shiguang Shan, and Xilin Chen. Mean-variance loss for deep age estimation from a face. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5285-5294, 2018.
  30. [Rothe et al., 2015] Rasmus Rothe, Radu Timofte, and Luc Van Gool. DEX: Deep expectation of apparent age from a single image. In 2015 IEEE International Conference on Computer Vision Workshop (ICCVW), pages 252-257, 2015.
  31. [Schifanella et al., 2021] Rossano Schifanella, Miriam Redi, and Luca Maria Aiello. An image is worth more than a thousand favorites: Surfacing the hidden beauty of flickr pictures. Proceedings of the International AAAI Confer- ence on Web and Social Media, 9(1):397-406, Aug. 2021.
  32. [Shi and Jain, 2019] Yichun Shi and Anil Jain. Probabilistic face embeddings. In 2019 IEEE/CVF International Con- ference on Computer Vision (ICCV), pages 6901-6910, 2019.
  33. [Shin et al., 2022] Nyeong-Ho Shin, Seon-Ho Lee, and Chang-Su Kim. Moving window regression: A novel approach to ordinal regression. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 18739-18748, 2022.
  34. [Verma et al., 2019] Vikas Verma, Alex Lamb, Christopher Beckham, Amir Najafi, Ioannis Mitliagkas, David Lopez- Paz, and Yoshua Bengio. Manifold mixup: Better rep- resentations by interpolating hidden states. In Kamalika Chaudhuri and Ruslan Salakhutdinov, editors, Proceed- ings of the 36th International Conference on Machine Learning, volume 97 of Proceedings of Machine Learn- ing Research, pages 6438-6447. PMLR, 09-15 Jun 2019.
  35. [Wang et al., 2021] Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, and Ling Shao. Pyramid Vision Transformer: A ver- satile backbone for dense prediction without convolutions. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 548-558, 2021.
  36. [Wang et al., 2023] Jinhong Wang, Yi Cheng, Jintai Chen, TingTing Chen, Danny Chen, and Jian Wu. Ord2Seq: Regarding ordinal regression as label sequence prediction. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pages 5842-5852, 2023.
  37. [Wang et al., 2024] Jinhong Wang, Zhe Xu, Wenhao Zheng, Haochao Ying, Tingting Chen, Zuozhu Liu, Danny Z. Chen, Ke Yao, and Jian Wu. A transformer-based knowledge distillation network for cortical cataract grad- ing. IEEE Transactions on Medical Imaging, 43(3):1089- 1101, 2024.
  38. [Wen et al., 2020] Xin Wen, Biying Li, Haiyun Guo, Zhiwei Liu, Guosheng Hu, Ming Tang, and Jinqiao Wang. Adap- tive variance based label distribution learning for facial age estimation. In Computer Vision -ECCV 2020: 16th Euro- pean Conference, Proceedings, Part XXIII, page 379-395, Berlin, Heidelberg, 2020. Springer-Verlag.
  39. [Wen et al., 2023] Changsong Wen, Xin Zhang, Xingxu Yao, and Jufeng Yang. Ordinal label distribution learning. In 2023 IEEE/CVF International Conference on Computer Vision (ICCV), pages 23424-23434, 2023.
  40. [Yi et al., 2015] Dong Yi, Zhen Lei, and Stan Z. Li. Age es- timation by multi-scale convolutional network. In Daniel Cremers, Ian Reid, Hideo Saito, and Ming-Hsuan Yang, editors, Computer Vision -ACCV 2014, pages 144-158, Cham, 2015. Springer International Publishing.
  41. [Zheng et al., 2024] Jiyang Zheng, Yu Yao, Bo Han, Dadong Wang, and Tongliang Liu. Enhancing contrastive learning for ordinal regression via ordinal content preserved data augmentation. In The Twelfth International Conference on Learning Representations, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards