Proceedings

GraphPerf-RT: Graph-Driven Performance Modeling with Calibrated Uncertainty for OpenMP Scheduling on Heterogeneous Embedded SoCs

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. AI4Tech: AI Enabling Technologies. Pages 6491-6499.

https://doi.org/10.24963/ijcai.2026/722

Abstract

Autonomous AI agents on embedded platforms require real-time, risk-aware scheduling under resource and thermal constraints. Classical heuristics struggle with workload irregularity, tabular regressors discard structural information, and model-free reinforcement learning (RL) risks overheating. We introduce GraphPerf-RT, an AI technology achieving deep learning accuracy at heuristic speeds (2-7ms). GraphPerf-RT is, to our knowledge, the first graph-grounded infrastructure unifying task DAG topology, CFG-derived code semantics, and runtime context (per-core DVFS, thermal state, utilization) in a heterogeneous graph with typed edges encoding precedence, placement, and contention. The architecture supports multi-task evidential heads with Normal-Inverse-Gamma uncertainty; we validate on makespan prediction for risk-aware scheduling. Experiments on three ARM platforms (Jetson TX2, Orin NX, RUBIK Pi) achieve R^2 = 0.81 on log-transformed makespan with Spearman rho = 0.95 and conservative uncertainty calibration (PICP = 99.9% at 95% confidence). Integration with four RL methods demonstrates that multi-agent model-based RL with GraphPerf-RT as the world model achieves 66% makespan reduction and 82% energy reduction versus model-free baselines, with zero thermal violations.

  1. [Ahn et al., 2022] Byung Hoon Ahn, Sean Kinzer, and Hadi Esmaeilzadeh. Glimpse: Mathematical embedding of hardware specification for neural compilation. In Proceed- ings of the 59th ACM/IEEE Design Automation Confer- ence (DAC), pages 1165-1170. ACM, 2022.
  2. [Amini et al., 2020] Alexander Amini, Wilko Schwarting, Ava Soleimany, and Daniela Rus. Deep evidential regres- sion. In Advances in Neural Information Processing Sys- tems 33 (NeurIPS 2020), pages 14927-14937, 2020.
  3. [Brauckmann et al., 2020] Alexander Brauckmann, Andrés Goens, Sebastian Ertel, and Jeronimo Castrillon. Compiler-based graph representations for deep learning models of code. In Proceedings of the 29th International Conference on Compiler Construction (CC 2020), pages 201-211, 2020.
  4. [Brent, 1974] Richard P. Brent. The parallel evaluation of general arithmetic expressions. Journal of the ACM, 21(2):201-206, 1974.
  5. [Cai et al., 2019] Han Cai, Ligeng Zhu, and Song Han. Prox- ylessnas: Direct neural architecture search on target task and hardware. In International Conference on Learning Representations (ICLR 2019), 2019.
  6. [Chen and Guestrin, 2016] Tianqi Chen and Carlos Guestrin. XGBoost: A scalable tree boosting system. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD '16), pages 785-794, 2016.
  7. [Cummins et al., 2021] Chris Cummins, Zacharias V. Fis- ches, Tal Ben-Nun, Torsten Hoefler, Michael F. P. O'Boyle, and Hugh Leather. Programl: A graph-based program representation for data flow analysis and compiler optimizations. In Proceedings of the 38th International Conference on Machine Learning (ICML 2021), volume 139 of Proceedings of Machine Learning Research, pages 2244-2253, 2021.
  8. [Eager and Sevcik, 1983] Derek L. Eager and Kenneth C. Sevcik. Performance bound hierarchies for queueing net- works. ACM Transactions on Computer Systems, 1(2):99- 115, 1983.
  9. [Graham, 1969] R. L. Graham. Bounds on multiprocessing timing anomalies. SIAM Journal on Applied Mathematics, 17(2):416-429, 1969.
  10. [Hebbar and Milenković, 2021] Ranjan Hebbar and Alek- sandar Milenković. An experimental evaluation of work- load driven DVFS. In Companion of the ACM/SPEC Inter- national Conference on Performance Engineering (ICPE '21), pages 95-102, 2021.
  11. [Hu et al., 2020] Ziniu Hu, Yuxiao Dong, Kuansan Wang, and Yizhou Sun. Heterogeneous graph transformer. In Proceedings of The Web Conference 2020 (WWW '20), pages 2704-2710. ACM, 2020.
  12. [Huang et al., 2010] Ling Huang, Jinzhu Jia, Bin Yu, Byung- Gon Chun, Petros Maniatis, and Mayur Naik. Predicting execution time of computer programs using sparse polyno- mial regression. In Advances in Neural Information Pro- cessing Systems 23 (NIPS 2010), pages 883-891, 2010.
  13. [Ipek et al., 2006] Engin Ipek, Sally A. McKee, Rich Caru- ana, Bronis R. de Supinski, and Martin Schulz. Efficiently exploring architectural design spaces via predictive mod- eling. In Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS XII), pages 195-206, 2006.
  14. [Kendall and Gal, 2017] Alex Kendall and Yarin Gal. What uncertainties do we need in Bayesian deep learning for computer vision? In Advances in Neural Information Pro- cessing Systems 30 (NIPS 2017), pages 5574-5584, 2017.
  15. [Kim et al., 2021] Seyeon Kim, Kyungmin Bin, Sangtae Ha, Kyunghan Lee, and Song Chong. zTT: Learning-based DVFS with zero thermal throttling for mobile devices. In Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services (MobiSys 2021), pages 41-53, 2021.
  16. [Lakshminarayanan et al., 2017] Balaji Lakshminarayanan, Alexander Pritzel, and Charles Blundell. Simple and scal- able predictive uncertainty estimation using deep ensem- bles. In Advances in Neural Information Processing Sys- tems 30 (NIPS 2017), pages 6402-6413, 2017.
  17. [Lee and Brooks, 2006] Benjamin C. Lee and David M. Brooks. Accurate and efficient regression modeling for microarchitectural performance and power prediction. In Proceedings of the 12th International Conference on Ar- chitectural Support for Programming Languages and Op- erating Systems (ASPLOS XII), pages 185-194, 2006.
  18. [Lin et al., 2023] Chengdong Lin, Kun Wang, Zhenjiang Li, and Yu Pu. A workload-aware DVFS robust to concurrent tasks for mobile devices. In Proceedings of the 29th An- nual International Conference on Mobile Computing and Networking (MobiCom 2023), pages 1-16, 2023.
  19. [Marsan et al., 1984] Marco Ajmone Marsan, Gianni Conte, and Gianfranco Balbo. A class of generalized stochastic petri nets for the performance evaluation of multiproces- sor systems. ACM Transactions on Computer Systems, 2(2):93-122, 1984.
  20. [Mendis et al., 2019] Charith Mendis, Alex Renda, Saman Amarasinghe, and Michael Carbin. Ithemal: Accurate, portable and fast basic block throughput estimation using deep neural networks. In Proceedings of the 36th Inter- national Conference on Machine Learning (ICML 2019), volume 97 of Proceedings of Machine Learning Research, pages 4505-4515, 2019.
  21. [Moerland et al., 2023] Thomas M. Moerland, Joost Broekens, Aske Plaat, and Catholijn M. Jonker. Model- based reinforcement learning: A survey. Foundations and Trends in Machine Learning, 16(1):1-118, 2023.
  22. [Papon and Wasay, 2022] Tarikul Islam Papon and Abdul Wasay. Silhouette: Toward performance-conscious and transferable CPU embeddings, 2022. Workshop on ML for Systems at NeurIPS 2023.
  23. [Pivezhandi and Saifullah, 2024] Mohammad Pivezhandi and Abusayeed Saifullah. Flowrl: Flow-augmented few- shot reinforcement learning for semi-structured sensor data. arXiv preprint arXiv:2409.14178, 2024.
  24. [Pivezhandi et al., 2025] Mohammad Pivezhandi, Abusay- eed Saifullah, and Prashant Modekurthy. Feature-aware task-to-core allocation in embedded multi-core platforms via statistical learning. In 2025 IEEE 31st International Conference on Embedded and Real-Time Computing Sys- tems and Applications (RTCSA), pages 102-113. IEEE, 2025.
  25. [Pivezhandi et al., 2026a] Mohammad Pivezhandi, Mahdi Banisharif, Abusayeed Saifullah, and Ali Jannesari. Zerodvfs: Zero-shot llm-guided core and frequency allocation for embedded platforms. arXiv preprint arXiv:2601.08166, 2026.
  26. [Pivezhandi et al., 2026b] Mohammad Pivezhandi, Abusay- eed Saifullah, and Ali Jannesari. Hidvfs: A hierarchi- cal multi-agent dvfs scheduler for openmp dag workloads. arXiv preprint arXiv:2601.06425, 2026.
  27. [Ramadan et al., 2023] Tarek Ramadan, Ankur Lahiry, and Tanzima Z Islam. Novel representation learning technique using graphs for performance analytics. In 2023 Interna- tional Conference on Machine Learning and Applications (ICMLA), pages 1311-1318. IEEE, 2023.
  28. [Sensoy et al., 2018] Murat Sensoy, Lance Kaplan, and Melih Kandemir. Evidential deep learning to quantify classification uncertainty. In Advances in Neural Informa- tion Processing Systems 31 (NeurIPS 2018), pages 3183- 3193, 2018.
  29. [Shao et al., 2022] Junru Shao, Xiyou Zhou, Siyuan Feng, Bohan Hou, Ruihang Lai, Hongyi Jin, Wuwei Lin, Masahiro Masuda, Cody Hao Yu, and Tianqi Chen. Ten- sor program optimization with probabilistic programs. In Advances in Neural Information Processing Systems 35 (NeurIPS 2022), pages 35783-35796, 2022.
  30. [Veličković et al., 2018] Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Liò, and Yoshua Bengio. Graph attention networks. In Inter- national Conference on Learning Representations (ICLR 2018), 2018.
  31. [Walker et al., 2017] Matthew J. Walker, Stephan Diestel- horst, Andreas Hansson, Anup Das, Sheng Yang, Bashir M. Al-Hashimi, and Geoff V. Merrett. Accurate and stable run-time power modeling for mobile and embedded CPUs. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems, 36(1):106-119, 2017.
  32. [Wang and O'Boyle, 2018] Zheng Wang and Michael F. P. O'Boyle. Machine learning in compiler optimization. Pro- ceedings of the IEEE, 106(11):1879-1901, 2018.
  33. [Wu et al., 2021] Zonghan Wu, Shirui Pan, Fengwen Chen, Guodong Long, Chengqi Zhang, and Philip S. Yu. A comprehensive survey on graph neural networks. IEEE Transactions on Neural Networks and Learning Systems, 32(1):4-24, 2021.
  34. [Wu et al., 2024] Yuefei Wu, Bin Shi, Bo Dong, Qinghua Zheng, and Hua Wei. The evidence contraction issue in deep evidential regression: Discussion and solution. In Proceedings of the 38th AAAI Conference on Artificial In- telligence, volume 38, pages 21726-21734, 2024.
  35. [Xie et al., 2021] Guoqi Xie, Xiongren Xiao, Hao Peng, Renfa Li, and Keqin Li. A survey of low-energy parallel scheduling algorithms. IEEE Transactions on Sustainable Computing, 7(1):27-46, 2021.
  36. [Zhai et al., 2023] Yi Zhai, Yu Zhang, Shuo Liu, Xiaomeng Chu, Jie Peng, Jianmin Ji, and Yanyong Zhang. TLP: A deep learning-based cost model for tensor program tuning. In Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2 (ASPLOS 2023), pages 833- 845, 2023.
  37. [Zhai et al., 2024] Yi Zhai, Sijia Yang, Keyu Pan, Renwei Zhang, Shuo Liu, Chao Liu, Zichun Ye, Jianmin Ji, Jie Zhao, Yu Zhang, and Yanyong Zhang. Enabling tensor language model to assist in generating high-performance tensor programs for deep learning. In 18th USENIX Sym- posium on Operating Systems Design and Implementation (OSDI 24), pages 289-305, 2024.
  38. [Zheng et al., 2020] Lianmin Zheng, Chengfan Jia, Minmin Sun, Zhao Wu, Cody Hao Yu, Ameer Haj-Ali, Yida Wang, Jun Yang, Danyang Zhuo, Koushik Sen, Joseph E. Gonza- lez, and Ion Stoica. Ansor: Generating high-performance tensor programs for deep learning. In 14th USENIX Sym- posium on Operating Systems Design and Implementation (OSDI 20), pages 863-879, 2020.
  39. [Zhu et al., 2022] Hongyu Zhu, Ruofan Wu, Yijia Diao, Shanbin Ke, Haoyu Li, Chen Zhang, Jilong Xue, Lingxiao Ma, Yuqing Xia, Wei Cui, Fan Yang, Mao Yang, Lidong Zhou, Asaf Cidon, and Gennady Pekhimenko. ROLLER: Fast and efficient tensor compilation for deep learning. In 16th USENIX Symposium on Operating Systems Design and Implementation (OSDI 22), pages 233-248, 2022.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards