Proceedings

Distribution-Aware Energy Minimization: Physical-Inspired Efficient Active Learning and Quantum Potentials

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 2019-2027.

https://doi.org/10.24963/ijcai.2026/225

Abstract

Active learning aims to maximize model performance with minimal annotation costs by selecting the most informative samples from large unlabeled pools, which often face a budget dilemma: uncertainty-based methods induce redundancy under low budgets, while representativeness-based methods struggle to mine challenging samples under high budgets. Although some heuristic parameter interpolation schemes attempt to bridge this gap, such strategies suffer from a misalignment between theoretical assumptions and real-world distributions, failing to achieve a good exploration-exploitation balance across all scenarios. In this paper, we propose a general active learning framework based on Distribution-Aware Energy Minimization, which reformulates sample selection as minimizing the energy function for the distributional discrepancy between the selected subset and the global uncertainty field. This physical-inspired perspective naturally derives a Hamiltonian comprising attractive terms and repulsive terms, mathematically achieving an intrinsic and dynamic balance between uncertainty and representativeness. Furthermore, we transform the optimization objective to the ground-state search of an Ising Model, enabling efficient solutions via Coherent Ising Machine. Extensive numerical experiments show that our method outperforms prior state-of-the-art methods across multi-budget regimes on several benchmark datasets. Validation on a real quantum hardware also demonstrates the potential for quantum computer in future large-scale selection tasks.

  1. [Ash et al., 2019] Jordan T Ash, Chicheng Zhang, Akshay Krishnamurthy, John Langford, and Alekh Agarwal. Deep batch active learning by diverse, uncertain gradient lower bounds. arXiv preprint arXiv:1906.03671, 2019.
  2. [Bae et al., 2025] Wonho Bae, Danica Sutherland, and Gabriel Oliveira. Uncertainty herding: One active learning method for all label budgets. In International Conference on Learning Representations, volume 2025, pages 788- 805, 2025.
  3. [Bassman Oftelie et al., 2018] Lindsay Bassman Oftelie, Pankaj Rajak, Rajiv K Kalia, Aiichiro Nakano, Fei Sha, Jifeng Sun, David J Singh, Muratahan Aykol, Patrick Huck, Kristin Persson, et al. Active learning for accel- erated design of layered materials. npj Computational Materials, 4(1):74, 2018.
  4. [Caramalau et al., 2021] Razvan Caramalau, Binod Bhat- tarai, and Tae-Kyun Kim. Sequential graph convolu- tional network for active learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9583-9592, 2021.
  5. [Cerezo et al., 2021] Marco Cerezo, Andrew Arrasmith, Ryan Babbush, Simon C Benjamin, Suguru Endo, Keisuke Fujii, Jarrod R McClean, Kosuke Mitarai, Xiao Yuan, Lukasz Cincio, et al. Variational quantum algorithms. Na- ture Reviews Physics, 3(9):625-644, 2021.
  6. [Chen et al., 2023] Shengminjie Chen, Donglei Du, Wenguo Yang, Dachuan Xu, and Suixiang Gao. Continuous non- monotone dr-submodular maximization with down-closed convex constraint. arXiv preprint arXiv:2307.09616, 2023.
  7. [Chen et al., 2024] Liangyu Chen, Yutong Bai, Siyu Huang, Yongyi Lu, Bihan Wen, Alan Yuille, and Zongwei Zhou. Making your first choice: to address cold start problem in medical active learning. In Medical Imaging with Deep Learning, pages 496-525. PMLR, 2024.
  8. [Chen et al., 2025] Shengminjie Chen, Ziyang Li, Hongyi Zhou, Jialin Zhang, Wenguo Yang, and Xiaoming Sun. A lyapunov framework for quantum algorithm design in combinatorial optimization with approximation ratio guar- antees. arXiv preprint arXiv:2512.21716, 2025.
  9. [Cornuejols et al., 1977] Gerard Cornuejols, Marshall L Fisher, and George L Nemhauser. Exceptional pa- per-location of bank accounts to optimize float: An ana- lytic study of exact and approximate algorithms. Manage- ment science, 23(8):789-810, 1977.
  10. [Ducoffe and Precioso, 2018] Melanie Ducoffe and Frederic Precioso. Adversarial active learning for deep networks: a margin based approach. arXiv preprint arXiv:1802.09841, 2018.
  11. [Dukkipati et al., 2025] Ambedkar Dukkipati, Ranga Shaarad Ayyagari, Bodhisattwa Dasgupta, Parag Dutta, and Prabhas Reddy Onteru. Active reinforcement learning strategies for offline policy improvement. In Proceed- ings of the AAAI Conference on Artificial Intelligence, volume 39, pages 16418-16425, 2025.
  12. [Farhi et al., 2014] Edward Farhi, Jeffrey Goldstone, and Sam Gutmann. A quantum approximate optimization al- gorithm. arXiv preprint arXiv:1411.4028, 2014.
  13. [Gal et al., 2017] Yarin Gal, Riashat Islam, and Zoubin Ghahramani. Deep bayesian active learning with image data. In International conference on machine learning, pages 1183-1192. PMLR, 2017.
  14. [Gissin and Shalev-Shwartz, 2019] Daniel Gissin and Shai Shalev-Shwartz. Discriminative active learning. arXiv preprint arXiv:1907.06347, 2019.
  15. [Gupte et al., 2024] Sanket Rajan Gupte, Josiah Aklilu, Jef- frey J Nirschl, and Serena Yeung-Levy. Revisiting active learning in the era of vision foundation models. arXiv preprint arXiv:2401.14555, 2024.
  16. [Hacohen et al., 2022] Guy Hacohen, Avihu Dekel, and Daphna Weinshall. Active learning on a budget: Oppo- site strategies suit high and low budgets. arXiv preprint arXiv:2202.02794, 2022.
  17. [Haussmann et al., 2020] Elmar Haussmann, Michele Fenzi, Kashyap Chitta, Jan Ivanecky, Hanson Xu, Donna Roy, Akshita Mittel, Nicolas Koumchatzky, Clement Farabet, and Jose M Alvarez. Scalable active learning for object detection. In 2020 IEEE intelligent vehicles symposium (iv), pages 1430-1435. IEEE, 2020.
  18. [Inagaki et al., 2016] Takahiro Inagaki, Yoshitaka Haribara, Koji Igarashi, Tomohiro Sonobe, Shuhei Tamate, Toshi- mori Honjo, Alireza Marandi, Peter L McMahon, Takeshi Umeki, Koji Enbutsu, et al. A coherent ising ma- chine for 2000-node optimization problems. Science, 354(6312):603-606, 2016.
  19. [Johnson et al., 2011] Mark W Johnson, Mohammad HS Amin, Suzanne Gildert, Trevor Lanting, Firas Hamze, Neil Dickson, Richard Harris, Andrew J Berkley, Jan Johans- son, Paul Bunyk, et al. Quantum annealing with manufac- tured spins. Nature, 473(7346):194-198, 2011.
  20. [Kirsch et al., 2019] Andreas Kirsch, Joost Van Amersfoort, and Yarin Gal. Batchbald: Efficient and diverse batch ac- quisition for deep bayesian active learning. Advances in neural information processing systems, 32, 2019.
  21. [Kochenberger et al., 2014] Gary Kochenberger, Jin-Kao Hao, Fred Glover, Mark Lewis, Zhipeng Lü, Haibo Wang, and Yang Wang. The unconstrained binary quadratic pro- gramming problem: a survey. Journal of combinatorial optimization, 28(1):58-81, 2014.
  22. [Koh and Liang, 2017] Pang Wei Koh and Percy Liang. Un- derstanding black-box predictions via influence functions. In International conference on machine learning, pages 1885-1894. PMLR, 2017.
  23. [Kulesza and Taskar, 2012] Alex Kulesza and Ben Taskar. Determinantal point processes for machine learning. Foun- dations and Trends® in Machine Learning, 5(2-3):123- 286, 2012.
  24. [Lewis and Gale, 1994] David D. Lewis and William A. Gale. A sequential algorithm for training text classifiers. In Proceedings of the 17th Annual International ACM SI- GIR Conference on Research and Development in Infor- mation Retrieval, SIGIR '94, page 3-12, Berlin, Heidel- berg, 1994. Springer-Verlag.
  25. [Lu et al., 2023] Yiren Lu, Guojing Tian, and Xiaoming Sun. Qaoa with fewer qubits: a coupling framework to solve larger-scale max-cut problem. arXiv preprint arXiv:2307.15260, 2023.
  26. [Lucas, 2014] Andrew Lucas. Ising formulations of many np problems. Frontiers in physics, 2:74887, 2014.
  27. [Lüth et al., 2023] Carsten Lüth, Till Bungert, Lukas Klein, and Paul Jaeger. Navigating the pitfalls of active learn- ing evaluation: A systematic framework for meaningful performance assessment. Advances in Neural Information Processing Systems, 36:9789-9836, 2023.
  28. [McMahon et al., 2016] Peter L McMahon, Alireza Marandi, Yoshitaka Haribara, Ryan Hamerly, Carsten Langrock, Shuhei Tamate, Takahiro Inagaki, Hiroki Takesue, Shoko Utsunomiya, Kazuyuki Aihara, et al. A fully programmable 100-spin coherent ising machine with all-to-all connections. Science, 354(6312):614-617, 2016.
  29. [Mukhoti et al., 2023] Jishnu Mukhoti, Andreas Kirsch, Joost Van Amersfoort, Philip HS Torr, and Yarin Gal. Deep deterministic uncertainty: A new simple baseline. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 24384-24394, 2023.
  30. [Nemhauser et al., 1978] George L Nemhauser, Laurence A Wolsey, and Marshall L Fisher. An analysis of approxima- tions for maximizing submodular set functions-i. Math- ematical programming, 1978.
  31. [Parvaneh et al., 2022] Amin Parvaneh, Ehsan Abbasnejad, Damien Teney, Gholamreza Reza Haffari, Anton Van Den Hengel, and Javen Qinfeng Shi. Active learning by feature mixing. In Proceedings of the IEEE/CVF confer- ence on computer vision and pattern recognition, pages 12237-12246, 2022.
  32. [Pinsler et al., 2019] Robert Pinsler, Jonathan Gordon, Eric Nalisnick, and José Miguel Hernández-Lobato. Bayesian batch active learning as sparse subset approximation. Ad- vances in neural information processing systems, 32, 2019.
  33. [Scheffer et al., 2001] Tobias Scheffer, Christian Decomain, and Stefan Wrobel. Active hidden markov models for in- formation extraction. In International symposium on intel- ligent data analysis, pages 309-318. Springer, 2001. Schmidt et al., 2025] Sebastian Schmidt, Leonard Schenk, Leo Schwinn, and Stephan Günnemann. Joint out-of- distribution filtering and data discovery active learning. In Proceedings of the Computer Vision and Pattern Recogni- tion Conference, pages 25677-25687, 2025.
  34. [Sener and Savarese, 2017] Ozan Sener and Silvio Savarese. Active learning for convolutional neural networks: A core- set approach. arXiv preprint arXiv:1708.00489, 2017.
  35. [Shui et al., 2020] C. Shui, F. Zhou, C. Gagné, et al. Deep active learning: Unified and principled method for query and training. In International Conference on Artificial In- telligence and Statistics, pages 1308-1318. PMLR, 2020.
  36. [Sinha et al., 2019] Samarth Sinha, Sayna Ebrahimi, and Trevor Darrell. Variational adversarial active learning. In Proceedings of the IEEE/CVF international conference on computer vision, pages 5972-5981, 2019.
  37. [Wang et al., 2024] Yifeng Wang, Xueying Zhan, and Siyu Huang. Autoal: Automated active learning with differentiable query strategy search. arXiv preprint arXiv:2410.13853, 2024.
  38. [Wei et al., 2015] Kai Wei, Rishabh Iyer, and Jeff Bilmes. Submodularity in data subset selection and active learning. In International conference on machine learning, pages 1954-1963. PMLR, 2015.
  39. [Yang et al., 2017] Lin Yang, Yizhe Zhang, Jianxu Chen, Siyuan Zhang, and Danny Z Chen. Suggestive annotation: A deep active learning framework for biomedical image segmentation. In International conference on medical im- age computing and computer-assisted intervention, pages 399-407. Springer, 2017.
  40. [Yehuda et al., 2022] Ofer Yehuda, Avihu Dekel, Guy Haco- hen, and Daphna Weinshall. Active learning through a covering lens. Advances in Neural Information Process- ing Systems, 35:22354-22367, 2022.
  41. [Yoo and Kweon, 2019] Donggeun Yoo and In So Kweon. Learning loss for active learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 93-102, 2019.
  42. [Yuan et al., 2023] Jiakang Yuan, Bo Zhang, Xiangchao Yan, Tao Chen, Botian Shi, Yikang Li, and Yu Qiao. Bi3d: Bi-domain active learning for cross-domain 3d object de- tection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15599- 15608, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards