Uncertainty-aware Predict-Then-Optimize Framework for Equitable Post-Disaster Power Restoration
Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. AI and Social Good. Pages 9719-9727.
https://doi.org/10.24963/ijcai.2025/1080
Keywords
- Uncertainty in AI: General
- Planning and Scheduling: General
- Machine Learning: General
- Data Mining: General
Abstract
The increasing frequency of extreme weather events, such as hurricanes, highlights the urgent need for efficient and equitable power system restoration. Many electricity providers make restoration decisions primarily based on the volume of power restoration requests from each region. However, our data-driven analysis reveals significant disparities in request submission volume, as disadvantaged communities tend to submit fewer restoration requests. This disparity makes the current restoration solution inequitable, leaving these communities vulnerable to extended power outages. To address this, we aim to propose an equity-aware power restoration strategy that balances both restoration efficiency and equity across communities. However, achieving this goal is challenging for two reasons: the difficulty of predicting repair durations under dataset heteroscedasticity, and the tendency of reinforcement learning agents to favor low-uncertainty actions, which potentially undermine equity. To overcome these challenges, we design a predict-then-optimize framework called EPOPR with two key components: (1) Equity-Conformalized Quantile Regression for uncertainty-aware repair duration prediction, and (2) Spatial-Temporal Attentional RL that adapts to varying uncertainty levels across regions for equitable decision-making. Experimental results show that our EPOPR effectively reduces the average power outage duration by 3.60% and decreases inequity between different communities by 14.19% compared to state-of-the-art baselines.
- [Afsharinejad et al., 2021] Amir Hossein Afsharinejad, Chuanyi Ji, and Robert Wilcox. Large-scale data analytics for resilient recovery services from power failures. Joule, 5(9):2504-2520, 2021.
- [An et al., 2021] Gaon An, Seungyong Moon, Jang-Hyun Kim, and Hyun Oh Song. Uncertainty-based offline rein- forcement learning with diversified q-ensemble. Advances in neural information processing systems, 34:7436-7447, 2021.
- [Bertsekas, 2014] Dimitri P Bertsekas. Constrained opti- mization and Lagrange multiplier methods. Academic press, 2014.
- [Chung et al., 2021] Youngseog Chung, Willie Neiswanger, Ian Char, and Jeff Schneider. Beyond pinball loss: Quantile methods for calibrated uncertainty quantifica- tion. Advances in Neural Information Processing Systems, 34:10971-10984, 2021.
- [Ez-Zizi et al., 2023] Adnane Ez-Zizi, Simon Farrell, David Leslie, Gaurav Malhotra, and Casimir JH Ludwig. Rein- forcement learning under uncertainty: expected versus un- expected uncertainty and state versus reward uncertainty. Computational Brain & Behavior, 6(4):626-650, 2023.
- [Gal and Ghahramani, 2016] Yarin Gal and Zoubin Ghahra- mani. Dropout as a bayesian approximation: Representing model uncertainty in deep learning. In international con- ference on machine learning, pages 1050-1059. PMLR, 2016.
- [Ganz et al., 2023] Scott C Ganz, Chenghao Duan, and Chuanyi Ji. Socioeconomic vulnerability and differential impact of severe weather-induced power outages. PNAS nexus, 2(10):pgad295, 2023.
- [Haarnoja et al., 2018] Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on ma- chine learning, pages 1861-1870. PMLR, 2018.
- [Ji et al., 2016] Chuanyi Ji, Yun Wei, Henry Mei, Jorge Calzada, Matthew Carey, Steve Church, Timothy Hayes, Brian Nugent, Gregory Stella, Matthew Wallace, et al. Large-scale data analysis of power grid resilience across multiple us service regions. Nature Energy, 1(5):1-8, 2016.
- [Jiang et al., 2023] Lin Jiang, Shuai Wang, Baoshen Guo, Hai Wang, Desheng Zhang, and Guang Wang. Faircod: A fairness-aware concurrent dispatch system for large-scale instant delivery services. In Proceedings of the 29th ACM SIGKDD Conference on knowledge discovery and data mining, pages 4229-4238, 2023. [Kenton and Toutanova, 2019]
- Jacob Devlin Ming- Wei Chang Kenton and Lee Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for lan- guage understanding. In Proceedings of naacL-HLT, volume 1. Minneapolis, Minnesota, 2019.
- [Koenker and Bassett Jr, 1978] Roger Koenker and Gilbert Bassett Jr. Regression quantiles. Econometrica: journal of the Econometric Society, pages 33-50, 1978.
- [Kull et al., 2019] Meelis Kull, Miquel Perello Nieto, Markus Kängsepp, Telmo Silva Filho, Hao Song, and Peter Flach. Beyond temperature scaling: Obtaining well-calibrated multi-class probabilities with dirichlet calibration. Advances in neural information processing systems, 32, 2019.
- [Kumar et al., 2020] Aviral Kumar, Aurick Zhou, George Tucker, and Sergey Levine. Conservative q-learning for offline reinforcement learning. Advances in Neural Infor- mation Processing Systems, 33:1179-1191, 2020.
- [Lan et al., 2022] Shiwei Lan, Shuyi Li, and Babak Shah- baba. Scaling up bayesian uncertainty quantification for inverse problems using deep neural networks. SIAM/ASA Journal on Uncertainty Quantification, 10(4):1684-1713, 2022.
- [Ma et al., 2021] Yi Ma, Xiaotian Hao, Jianye Hao, Jiawen Lu, Xing Liu, Tong Xialiang, Mingxuan Yuan, Zhigang Li, Jie Tang, and Zhaopeng Meng. A hierarchical reinforce- ment learning based optimization framework for large- scale dynamic pickup and delivery problems. Advances in neural information processing systems, 34:23609-23620, 2021.
- [Meinshausen and Ridgeway, 2006] Nicolai Meinshausen and Greg Ridgeway. Quantile regression forests. Journal of machine learning research, 7(6), 2006.
- [NHC.gov, 2019] NHC.gov. Tropical cyclone report: Hurri- cane michael (al142018). https://www.nhc.noaa.gov/data/ tcr/AL142018 Michael.pdf, 2019. Link
- [Panaretos and Zemel, 2019] Victor M Panaretos and Yoav Zemel. Statistical aspects of wasserstein distances. An- nual review of statistics and its application, 6(1):405-431, 2019.
- [Pessach and Shmueli, 2022] Dana Pessach and Erez Shmueli. A review on fairness in machine learning. ACM Computing Surveys (CSUR), 55(3):1-44, 2022.
- [Rahaman and others, 2021] Rahul Rahaman et al. Uncer- tainty quantification and deep ensembles. Advances in neural information processing systems, 34:20063-20075, 2021.
- [Rasul et al., 2021] Kashif Rasul, Calvin Seward, Ingmar Schuster, and Roland Vollgraf. Autoregressive denois- ing diffusion models for multivariate probabilistic time se- ries forecasting. In International Conference on Machine Learning, pages 8857-8868. PMLR, 2021.
- [Romano et al., 2019] Yaniv Romano, Evan Patterson, and Emmanuel Candes. Conformalized quantile regression. Advances in neural information processing systems, 32, 2019.
- [Shafer and Vovk, 2008] Glenn Shafer and Vladimir Vovk. A tutorial on conformal prediction. Journal of Machine Learning Research, 9(3), 2008.
- [Takeuchi et al., 2006] Ichiro Takeuchi, Quoc V Le, Timo- thy D Sears, Alexander J Smola, and Chris Williams. Non- parametric quantile estimation. Journal of machine learn- ing research, 7(7), 2006.
- [Tas ¸et al., 2016] Duygu Tas ¸, Michel Gendreau, Ola Jabali, and Gilbert Laporte. The traveling salesman problem with time-dependent service times. European Journal of Oper- ational Research, 248(2):372-383, 2016. [
- [USA.gov, 2024] USA.gov. Hurricane helene. https://www. usa.gov/hurricane-helene, 2024. Link
- [Waswani et al., 2017] A Waswani, N Shazeer, N Parmar, J Uszkoreit, L Jones, A Gomez, L Kaiser, and I Polo- sukhin. Attention is all you need. In NIPS, 2017.
- [Wen et al., 2023] Haomin Wen, Youfang Lin, Yutong Xia, Huaiyu Wan, Qingsong Wen, Roger Zimmermann, and Yuxuan Liang. Diffstg: Probabilistic spatio-temporal graph forecasting with denoising diffusion models. In Pro- ceedings of the 31st ACM International Conference on Ad- vances in Geographic Information Systems, pages 1-12, 2023.
- [White, 1980] Halbert White. A heteroskedasticity- consistent covariance matrix estimator and a direct test for heteroskedasticity. Econometrica: journal of the Econometric Society, pages 817-838, 1980.
- [Xu and Tang, 2020] Corey Kewei Xu and Tian Tang. Clos- ing the gap or widening the divide: The impacts of technology-enabled coproduction on equity in public ser- vice delivery. Public administration review, 80(6):962- 975, 2020.
- [Yan et al., 2024] Hua Yan, Heng Tan, Haotian Wang, Desh- eng Zhang, and Yu Yang. Robust route planning under un- certain pickup requests for last-mile delivery. In Proceed- ings of the ACM on Web Conference 2024, pages 3022- 3030, 2024.
- [Zhang et al., 2021] Zizhen Zhang, Hong Liu, MengChu Zhou, and Jiahai Wang. Solving dynamic traveling sales- man problems with deep reinforcement learning. IEEE Transactions on Neural Networks and Learning Systems, 34(4):2119-2132, 2021.
- [Zhuang et al., 2022] Dingyi Zhuang, Shenhao Wang, Haris Koutsopoulos, and Jinhua Zhao. Uncertainty quantifi- cation of sparse travel demand prediction with spatial- temporal graph neural networks. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 4639-4647, 2022.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
1 Introduction
Power restoration following extreme weather events is crucial for social well-being. In the Southeastern United States, many areas are particularly vulnerable to hurricanes, which can cause severe disruptions. For instance, in September 2024, Category 5 Hurricane Helene struck Florida, Georgia, and North Carolina, affecting 1.7 million people and causing an estimated $78.7 billion in damages [USA.gov, 2024]. Through interviews with government agencies and real-world data analysis in Florida, we found that obtaining real-time power status across all communities and households after a hurricane remains a significant challenge. As a result, the government has launched online platforms, such as Florida's 311 system [Xu and Tang, 2020], to allow residents to submit power repair requests. These submissions help authorities prioritize regional power restoration, often giving precedence to communities reporting the highest number of outages.
∗Corresponding author
Although the current strategy can be effective in certain cases, it often exacerbates existing inequalities by disproportionately impacting economically and socially disadvantaged communities. Due to limited awareness of submission channels, residents in these communities typically file fewer requests, making them more likely to be overlooked in government decision-making. Therefore, it is crucial to develop an equity-aware power restoration strategy that balances restoration efficiency with fairness across all communities.
However, two major challenges arise in achieving this. First, heteroscedasticity in the training data [White, 1980] poses a challenge to regional repair duration prediction. Repair durations, which are critical for determining restoration sequences, are typically derived from historical repair request data. However, as our findings suggest, the volume of repair requests varies significantly across regions, introducing heteroscedasticity into the data. This variability hampers the ability to make deterministic predictions, and directly applying traditional uncertainty quantification methods such as conformal prediction [Shafer and Vovk, 2008] can result in inequities across sensitive features. Second, traditional optimization methods like reinforcement learning (RL) prioritize information with lower uncertainty to minimize error accumulation [Kumar et al., 2020]. Hence, directly applying these methods would lead to regions with smaller local variances being prioritized, which conflicts with our equity objective.
To address these challenges, we propose an Equity-aware Predict-then-Optimize Power Restoration framework, called EPOPR. The objective is to minimize the total outage duration while ensuring that outage durations across communities satisfy equity criteria. EPOPR consists of two key components: (1) Equity-Conformalized Quantile Regression (ECQR) for uncertainty-aware repair duration prediction. In a heteroscedastic dataset, some sensitive features may have limited data coverage and wider prediction intervals, potentially compromising equity in subsequent decisions. To address this, ECQR incorporates equity-based uncertainty calibration to maintain uniform average coverage across sensitive features. Additionally, it employs dynamic prediction intervals that adapt to varying levels of dispersion across sensitive features. (2) Spatial-Temporal Attentional Soft ActorCritic (STA-SAC) for optimizing the repair sequence. The key innovation lies in the spatial-temporal attention-based Actor, which captures spatiotemporal dependencies among uncertainties while handling the dynamic nature of the action set. Meanwhile, we integrate the Lagrange Multiplier [Bertsekas, 2014] into Soft Actor-Critic [Haarnoja et al., 2018], our base RL model, to solve the multi-objective optimization problem that balances both efficiency and equity.
The key contributions of this paper include:
- From a data-driven perspective, our analysis of realworld power restoration datasets reveals two key insights: (1) The current power restoration process is inequitable, as it tends to prioritize communities with higher volumes of repair requests, typically those that are economically and socially advantaged. (2) Repair request submissions vary significantly across regions, introducing heteroscedasticity into the training data and complicating subsequent decision-making.
- From a technical design perspective, inspired by our data-driven findings, we propose an equity-aware predict-then-optimize power restoration framework, EPOPR, with novel enhancements at both the prediction and decision-making stages. For repair duration prediction, we introduce ECQR, which incorporates equityaware uncertainty calibration to ensure uniform average coverage across sensitive features, while employing dynamic prediction intervals to preserve overall statistical efficiency. For repair sequence decision-making, we develop STA-SAC, an RL method designed to minimize total outage duration while enforcing equity-aware constraints. Specifically, STA-SAC employs a SpatialTemporal Attentional Actor to jointly capture predictive uncertainty and its spatiotemporal dependencies.
- We comprehensively evaluate EPOPR using the realworld power outage datasets from Tallahassee, Florida. Experimental results demonstrate that EPOPR reduces average outage duration by 3.60% and decreases inequity among regions by 14.19%, outperforming the best baseline. Specifically, we independently assess our prediction method, ECQR, which enhances prediction performance in disadvantaged regions and produces a more equitable output. This equity-aware prediction further enables our decision-making method STA-SAC to significantly narrow the disparity in power outage durations across regions with different income levels.
2 Data Analysis AndMotivation
In this project, we collaborate with the City of Tallahassee Government in Florida to improve its power outage restoration services. The city provided us with detailed householdlevel datasets on outage repair requests and electricity usage after signing a non-disclosure agreement. Both datasets contain one year of data records from Tallahassee in 2018. Notably, they capture the city's power restoration process during Hurricane Michael in October 2018-a Category 5 storm that caused large-scale outages in the city [NHC.gov, 2019]. Moreover, our collaborator from Public Administration and Policy offered detailed investigations and analyses from a Social Science perspective [Xu and Tang, 2020], helping us identify key variables influencing government decisionmaking and understand how these factors may contribute to inequities in the power restoration process. Building on these collaborations, we conducted an in-depth, data-driven analysis that yielded the following key findings:
- (i) The number of repair requests surges significantly after a hurricane, yet their distribution varies considerably across regions. Figures 1 and 2 illustrate the fluctuations in repair request submissions across both spatial and temporal dimensions. In the temporal dimension, we observe a sharp increase in repair requests within the first week after the hurricane, indicating that residents rely heavily on this method to report power outages. In the spatial dimension, the number of requests varies significantly across regions due to multiple factors, including the severity of outages and residents' awareness of available reporting channels.
- (ii) The current power restoration strategy in Tallahassee disproportionately disadvantages economically and socially disadvantaged communities. Interviews with government officials revealed that obtaining real-time power status across all regions after a hurricane remains a significant challenge. Consequently, the government often relies on repair request volume to determine the restoration sequence. However, this approach leads to inequities, as regions with fewer repair requests are more likely to experience prolonged power outages. As shown in Figure 3, regions that submitted fewer repair requests (10 or fewer) experienced 34.19% longer power outage durations than those with over 10 requests. In Figure 4, we present the cumulative distribution function (CDF) of power outage durations across all regions during the hurricane. The data reveals that 40% of outages were restored






within two days, while over 12% of residents still experienced outages lasting more than four days. We also examine the socioeconomic status of regions experiencing longer power outages. Using average annual income as a representative metric, Figure 5 reveals a negative correlation between power outage duration and income levels, with a Pearson correlation coefficient of -0.61. This finding indicates that lower-income regions tend to endure longer power outages. Motivated by this, our research aims to develop an AI-driven power restoration strategy that enhances social equity.
(iii) The historical regional repair request data exhibits heteroscedasticity. In Figure 6, we visualize the distribution of historical repair durations across different regions. The shaded area represents the 90% quantile interval (ranging from the 5th to the 95th percentile), while the dashed line indicates the midpoint of this range. It can be observed that the variance of historical repair durations differs significantly across regions. For example, Region 2 has a narrower quantile interval, whereas Regions 4 and 7 have wider intervals. This pronounced heteroscedasticity poses challenges for applying deterministic prediction methods. Moreover, traditional uncertainty-aware prediction approaches often introduce bias, as their predictive accuracy tends to be higher for groups with more data (e.g., richer communities), further exacerbating disparities across socioeconomic groups.
3 Methodology
3.1 SystemOverview
In this paper, we design an equity-aware predict-thenoptimize power restoration framework called EPOPR, considering both recovery efficiency and equity. The problem is formulated as follows:
In Equation 1, we present our optimization objective, which seeks to minimize the average expected outage duration across all regions. The feature F represents an equityrelated feature. Taking the average income as an example, we categorize F into three groups: high, middle, and low.
In Equation 2, we present our equity-aware constraints. Inspired by the fairness definition of demographic equity [Pessach and Shmueli, 2022], we define equity as the condition that the difference in outage duration distributions across different sensitive groups of regions does not exceed a predefined upper bound d-for example, the difference in outage duration between high-income and low-income regions should not be too large. To better capture the overall distributional difference, we use the Wasserstein distance W(P(Toutage | Fk1 ), P(Toutage | Fk2 )) to represent the disparity [Panaretos and Zemel, 2019].
According to our optimization formulation, the regional outage duration Toutage(Fk) (abbreviated as Toutage when the sensitive feature Fk is not explicitly considered) plays a crucial role. The outage duration for region m, T (m) outage , consists of two components: waiting duration T (m) waiting and repair duration T (m) repair . The waiting duration, T (m) waiting , can further be represented as the sum of the repair durations of all regions preceding region m, i.e., ∑m-1 j=1 T (j) repair , and the time spent on the road, Ttravel. The equation is shown below:
Based on the formulation in Equation 3, we break down our optimization problem into two key subproblems: predicting the outage repair duration for each region, which relates to T (m) repair , and determining the repair sequence, which is related to T (m) waiting . Accordingly, our EPOPR framework consists of two main components: a prediction module called ECQR that estimates the repair duration Trepair for each region, and a decision module called STA-SAC that determines the repair sequence across different regions. An overview of the EPOPR framework is illustrated in Figure 7.

3.2 ECQR for Prediction
In this section, we describe how we estimate repair durations Trepair across different regions. A key challenge, as discussed earlier, is the substantial variation in repair request volumes across regions. This leads to an unevenly distributed training set and results in heteroscedasticity. For such highvariance data, deterministic predictions often underperform, especially in underrepresented regions. To address this, we adopt uncertainty-aware prediction. However, this approach alone may still lead to unfair outcomes. Due to heteroscedasticity, the variance in repair durations differs across regions
(as shown in Figure 6), and regions with higher variance often experience poorer prediction performance, making it more difficult for them to receive equitable restoration services.
To handle this, we propose Equity-Conformalized Quantile Regression (ECQR) based on traditional CQR [Romano et al., 2019]. Our method has two distinct advantages: (1) We provide a group-based calibration factor to ensure equitable coverage. Although this may slightly reduce prediction coverage for advantaged groups, it significantly narrows the coverage gap between advantaged and disadvantaged groups. (2) Inheriting the advantages of original CQR, ECQR also provides dynamic prediction intervals for different regions, making it particularly suitable for heteroscedastic datasets and improving overall prediction performance.
We now introduce ECQR in detail. Let the original dataset D be denoted as {(xi, fi, yi) : i ∈ D}, where xi represents the features of sample i, fi corresponds to equity-related sensitive features, and yi denotes the target variable. In our scenario, xi is a 9-dimensional vector including the region's location and contextual information, and fi represents the region's average annual income, divided into three sensitive groups, with yi denoting the region's repair duration.
The dataset D is split into a training dataset D1 and a calibration dataset D2. First, we use Quantile Regression Forest (QRF) [Meinshausen and Ridgeway, 2006] to fit two conditional quantile functions ˆ qα lo and ˆ qα hi , as shown below:
Where ˆ qαlo and ˆ qαhi represent the conditional quantile functions for the lower and upper bounds of prediction α, respectively. The definition for ˆ qα(x) is shown as below:
For example, if we pursue the prediction interval with coverage rate α as 90%, then αlo = 1-α 2 and αhi = 1+α 2 . We use PIQRF (xi) to represent the prediction interval for sample i:
Directly applying the prediction interval PIQRF learned from quantile regression is impractical because the validity of estimated intervals is only guaranteed for specific models rather than our heteroscedasticity setting [Takeuchi et al., 2006]. Therefore, we compute conformity scores in the calibration dataset D2 to quantify prediction interval error and calibrate it. The conformity score E is calculated as follows:
In original CQR, the method sorts all Ei values and selects a specific quantile of Ei to calibrate the prediction interval:
Specifically, the method selects the ⌈α(|D2| + 1)⌉-th smallest conformity score E(⌈α(|D2|+1)⌉) as the calibration factor Qα(E,D2) for adjusting the prediction interval. Where ⌈⌉ represents the ceiling function. The prediction interval PICQR(xi) can be represented as:
However, the original CQR does not account for the influence of the sensitive feature F. As shown in Equation 9, the sorting of all conformity scores Ei is independent of the corresponding sensitive feature fi. In other words, all samples in the calibration set D2 are sorted without considering their sensitive attributes. As a result, the scores covered by the calibration factor Qα(E, D2) (i.e., from E1 to E⌈α(|D2|+1)⌉) may have imbalanced sensitive feature distributions. For instance, due to higher variance, samples from low-income regions are less likely to fall within the calibrated range.
In ECQR, we redefine the calibration dataset D2 based on the sensitive feature F :
Where Fk means the k-th sensitive group in sensitive feature F . After each sensitive group Fk has a corresponding calibration dataset D2(Fk), we calculate the group-based calibration factor Qα(E,D2(Fk)) separately through the D2(Fk) rather than the whole D2. Based on that, we get the prediction interval PIECQR(Xi, fi) for our method ECQR:
From Equation 12, it can be observed that when predicting the prediction interval PIECQR(xi, fi) for sample i, we account for its sensitive feature fi and apply the corresponding calibration factor Qα(E,D2(Fk)) based on the sensitive group Fk associated with the sample. This group-based approach ensures that the system's output maintains the same theoretical coverage across all sensitive groups.
To conclude, our ECQR represents uncertainty prediction outputs as prediction intervals PIECQR(xi, fi), offering two key advantages: equitable coverage across all sensitive groups and the dynamic prediction interval for every sample i. In the next section, we will introduce the decision-making module and explain how the prediction intervals are used in STA-SAC for equity-aware power restoration.
3.3 STA-SAC for Decision-Making
CMDP Problem Formulation
Formally, we model our equity-aware power restoration problem as a Constrained Markov Decision Process (CMDP), and propose a new reinforcement learning algorithm called STASAC to solve it. We define the CMDP problem G as the 6tuple: G = {S, A, P, R, C, µ}, where S is the state space, A is the action space, P : S×A×S → [0, 1] denotes the transition probability function, R represents the reward function, C represents the cost function, µ is the initial state distribution. The details of the CMDP G in our problem are shown below.
- State S: We consider the power repair team as the agent. We define the state st of the agent at step t as st = STt, where STt represents the agent's spatiotemporal state, encompassing the current region r, the current time Tt, and its current coordinates.
- Action A: We define the action as selecting the next power outage-affected region for repair. At each time step t, the action space At = {a1t , a2t , . . . , ant }, where art corresponds
to the features of the r-th region, and n is the number of candidate regions available for repair. Each action art is defined as art = {PI r t , ST r t ,COr }, where PI r t represents uncertainty information, specifically the prediction interval for repair duration in region r. ST r t represents spatiotemporal information of region r at time t. COr = {idr , disr , senr } denotes contextual information for region r, including its identifier idr , distance disr from the repair team's current location, and sensitive feature senr .
- Reward R: We assign the reward only at the end of each episode. Specifically, during all previous steps, the system provides no reward feedback (i.e., a reward of 0) until all regions have been restored with power. Once all regions are repaired, the system provides a reward reflecting the effectiveness of the entire repair process. In EPOPR, based on our optimization problem defined in Equation 1, we use the negative average outage durations across all regions as the reward. The reward is calculated as follows:
where T r outage represents the outage duration for region r, and N is the total number of power outage regions.
- Cost C: We assign the cost only at the end of each episode, similar to our reward setting. The cost is defined as the maximum Wasserstein distance between the outage duration distributions of all possible pairs of sensitive groups. It is calculated as follows:
where Fk1 and Fk2 represent any pair of sensitive groups. We require that the cost C does not exceed the predefined upper limit d, which follows our equity criteria: ensure that the overall difference between the two groups remains within an acceptable range.
In the CMDP problem, the final optimization problem is:
To address the aforementioned problem, we propose STASAC, which includes an Actor for action selection and four Critic networks for action value estimation. A key challenge in STA-SAC is effectively modeling the spatial-temporal correlations among these uncertainties while handling the dynamic nature of the action set. In the following section, we will introduce the Spatial-Temporal Attention Actor and show how it addresses this challenge.
Spatial-Temporal Attentional Actor
In reinforcement learning, the Actor selects the next action based on the agent's current state, typically represented as π(at|st). Unlike traditional approaches, STA-SAC considers both the current state st and the entire action set At, where each action art ∈ At is associated with uncertainty information PI r t . Notably, the size of At is dynamic at each decision step in real-world settings. To address this, our SpatialTemporal Attentional Actor leverages an Action Pruning Mask and a Transformer-based architecture [Waswani et al., 2017] to handle the varying size of At. A query-key attention mechanism is used to capture global dependencies within the action set and estimate the selection probability of each candidate action. The overall architecture of the Spatial-Temporal Attentional Actor is illustrated in Figure 8.

In Spatial-Temporal Attention Actor, we assume that the total number of all outage regions is N, and we denote the set of these regions as the Full Action Space. Through the Action Prune Mask, we mask certain candidate actions to obtain the action space At at step t. The masking logic mainly focuses on: excluding previously selected actions and actions whose corresponding regions are too far from the repair team.
After obtaining the Step Action Space At at step t, we employ the Transformer to simultaneously perform two tasks: (1) embedding the entire action space At and (2) integrating global information into each action. For the first task, we input the [CLS] token [Kenton and Toutanova, 2019] to obtain the embedding of the action space. For the second task, we concatenate the output from the Transformer for each action with the action itself to form the new action representation.
Finally, we adopt the query-key mechanism from attention to generate our policy π(art |st, At). We concatenate the Action Space Embedding with the agent's current state st to form the Query Qt, and treat all candidate actions as the Keys [K1 t ,K2 t , . . . ,Kn t ]. The action score χrt for the r-th action art is calculated as:χrt = vaσ(Wa[Kr t ⊕ Qt]), where ⊕ denotes concatenation. The policy π(art |st,At) is then computed based on all candidate actions as:
Here, π(art |st,At) represents the probability of selecting the action art (i.e., the next region r to be repaired) based on the current state st and action space At [Jiang et al., 2023].
Training Method
In STA-SAC, we adopt SAC-Lagrangian as the foundation of our RL model and incorporate the Lagrange multiplier λ to integrate cost constraints into the reward-based optimization objective. STA-SAC consists of one Actor and four Critic networks. The Actor leverages our Spatial-Temporal Attention mechanism, while the Critic networks evaluate action values and guide decision-making. Specifically, the Actor is represented as πθ(art |st,At), where θ denotes its learnable parameters. The Reward and Cost Critic networks are Qwr{1,2} (st, at) and Qwc{1,2} (st, at), respectively, with wr1 ,wr2 ,wc1 ,wc2 as their learnable parameters.
To update the reward Critic networks, we minimize the following loss function for i = 1, 2:
Where M is the number of episodes per update cycle, N is the length of each episode, γ is the discount factor, and β determines entropy importance. wrj denotes the target network parameters of wrj , a common RL technique. The cost Critic networks share a similar update strategy in Equation 17. To update the Actor, we minimize the following loss:
For Lagrange multiplier λ, it follows the updating rules:
where ηλ denotes the step size for updating λ. More details of SAC-Lagrangian can be found in [Haarnoja et al., 2018].
4 Evaluation
4.1 EvaluationMethodology
Data: We use two one-year power outage datasets in 2018 from Tallahassee, Florida, to evaluate the proposed predictthen-optimize power restoration framework. We can extract two key pieces of information from the data: power outage duration and repair duration for each region. We build a simulation environment based on these two datasets where the repair team travels from one region to another region according to the decisions made by algorithms. In our simulation, for every episode, the repair duration for each region is directly sampled from historical outage records, reflecting realworld repair duration patterns. The simulation ends when all regions are repaired, marking one complete episode.
Metrics: We design two metrics to evaluate our approach:
Power Outage Duration ˆ Toutage: The average power outage duration across all regions. This metric quantifies the power restoration efficiency. The unit of this value is the hour.
Power Restoration Inequity WDinequity: This metric quantifies disparity in outage durations across socioeconomic groups. Specifically, we compute the Wasserstein distance between outage duration distributions of different sensitive groups and take the maximum value to capture the most significant inequality. The formal definition of the Wasserstein distance is in Equation 2. Particularly, a smaller WDinequity indicates greater equity in power restoration.
Baselines: We compare EPOPR with the following base-
lines. (1) GroundTruth (GT): This baseline directly extracts the repair sequence from our real data. (2) Greedy Method (GM): The repair team always prioritizes repairing the region nearest to its current location. (3) TSP-ST [Tas¸ et al., 2016]: We formulate the sequential repair task as a Traveling Salesman Problem (TSP) with service times, where each region has a repair duration. This approach minimizes the sum of repair and travel durations. (4) RL-DTSP [Zhang et al., 2021]: This method employs a DQN-based decision maker for route planning under deterministic predictions, where a Random Forest model provides each region's repair duration. (5) HRL-DPDP [Ma et al., 2021]: This method uses hierarchical reinforcement learning. The upper-level agent decides which type of region to repair first, while the lowerlevel agent selects the specific region. It relies on the same deterministic prediction inputs as RL-DTSP. (6) ROPU [Yan et al., 2024]: A predict-then-optimize approach with uncertainty consideration. It utilizes Conformal Prediction for prediction and an Actor-Critic framework for decision-making.
4.2 Overall Performance
We compare EPOPR with baselines and summarize the results in Table 1. In our experiment, we set the upper limit d to 8. The regional division method is based on the US Census Tract, and the region size N in our experiment is set to be 55. Our key findings are: (1) Our method achieves the shortest average outage duration and the most equitable outage distribution. Specifically, it reduces outage duration by 20.44% and restoration inequity by 49.87% compared to the ground truth. Furthermore, compared to the best-performing baseline, ROPU, our method reduces these metrics by 3.60% and 14.19%, respectively. (2) Among baselines, the optimizerbased method TSP-ST outperforms RL-based RL-DTSP for small-scale optimization (where N is typically less than 100). The hierarchical RL-based HRL-DPDP performs poorly because multi-level objectives make the system prone to local optimization. Meanwhile, uncertainty-aware prediction-thenoptimize methods, ROPU and EPOPR, significantly outperform others by quantifying uncertainty for reliable decisions.
| Method | ˆ Toutage ↓ (h) | WDinequity ↓ |
|---|---|---|
| GT | 57.521 | 17.344 |
| GM | 53.287 | 16.365 |
| TSP-ST | 49.337 | 11.389 |
| RL-DTSP | 50.853 | 11.952 |
| HRL-DPDP | 56.924 | 15.725 |
| ROPU | 47.471 | 10.132 |
| EPOPR | 45.762 | 8.694 |
4.3 Results for Repair Duration Prediction
To assess the effectiveness of our uncertainty-aware outage prediction method, ECQR, we compare it with two commonly used baselines: Conformal Prediction (CP) [Shafer and Vovk, 2008] and Conformalized Quantile Regression (CQR) [Romano et al., 2019]. Prediction interval quality is evaluated using coverage rate and interval length. Figure 9 shows coverage rates for three sensitive groups, with a 90% target (red dashed line). Compared to baselines, ECQR significantly reduces disparity among groups. While slightly lowering coverage in high-income regions compared to CQR, it notably improves coverage in low-income regions, ensuring all groups reach the target. Figure 10 shows that ECQR reduces interval length in low-income regions by 15.0% and 11.4% compared to the other two methods. Overall, ECQR delivers more reliable predictions for low-income regions, narrowing the gap with other groups for better equity.


4.4 Results for Outage Duration Distribution
We show the outage duration distribution under our method EPOPR and the current situation in Figure 11 and 12, respectively. The figures on the left depict power outage durations across the city, with darker blue indicating longer outages. The figures on the right present outrage durations of each region. By comparing the two figures, we can see our method reduces the differences in outage durations across sensitive groups, demonstrating its performance to improve equity.


5 RelatedWork
Uncertainty Quantification: In recent years, uncertainty quantification (UQ) has attracted widespread attention in both prediction [Wen et al., 2023; Rasul et al., 2021; Zhuang et al., 2022] and decision-making [Yan et al., 2024; An et al., 2021; Ez-Zizi et al., 2023] tasks, as reliable uncertainty estimation not only enhances model interpretability but also provides a solid foundation for downstream decision tasks. Bayesian methods, such as Bayesian Neural Networks (BNN) [Gal and Ghahramani, 2016; Lan et al., 2022], introduce probability distributions over the weights of the neural network and use Bayesian inference for uncertainty estimation. Predictive distribution methods explicitly model the output distribution to capture uncertainty. For example, Quantile Regression (QR) [Koenker and Bassett Jr, 1978; Chung et al., 2021] estimates various quantiles of the target distribution, yielding intervalbased uncertainty estimates. In contrast, Deep Ensembles [Rahaman and others, 2021] train multiple independent neural networks and aggregate their predictions to approximate the overall predictive uncertainty. Calibration methods aim to ensure that a model's predicted confidence levels accurately correspond to the true probabilities, thereby improving the reliability of uncertainty estimates. For example, temperature scaling [Kull et al., 2019] adjusts the softmax outputs so that the predicted confidence scores more closely reflect the actual probability distribution.
Post-Disaster Power Restoration: Many studies have explored post-disaster power restoration from various disciplines. Here, we focus on data-driven approaches. [Afsharinejad et al., 2021] employs unsupervised learning on real-world power grid data from New York and Massachusetts to analyze recovery capabilities under government policies. [Ji et al., 2016; Ganz et al., 2023] investigates the relationship between socioeconomic vulnerability and the differential impact of severe weather-induced power outages through large-scale data analysis. [Xu and Tang, 2020] investigates how the public service platform after disasters affects distributional equity in public service delivery, and how the government utilizes such a digital platform to improve postdisaster power restoration efficiency.
6 Conclusion
Motivated by our data-driven analysis, we found that the current power restoration decisions may be inequitable, as it is highly related to the number of repair requests from each region. This reliance on request volume creates significant disparities, often resulting in disadvantaged areas with fewer submissions receiving lower priority in the restoration process. To address this challenge, we design an equity-aware predict-then-optimize power restoration framework called EPOPR, which consists of two key components: (1) ECQR for repair duration prediction, ensuring equitable prediction intervals across all sensitive groups, and (2) STA-SAC for repair sequence decision-making, which aims to minimize the total outage duration while enforcing fairness constraints. Evaluations on real-world data demonstrate that EPOPR reduces the average outage duration by 3.60% and mitigates regional inequities by 14.19% compared to the best baseline.
Acknowledgments
We sincerely thank all anonymous reviewers for their constructive comments. This work is partially supported by Florida State University, National Science Foundation under Grant Numbers 2315027 and 1940319.
@inproceedings{ijcai2025p1080,
title = {Uncertainty-aware Predict-Then-Optimize Framework for Equitable Post-Disaster Power Restoration},
author = {Jiang, Lin and Yu, Dahai and Xu, Rongchao and Tang, Tian and Wang, Guang},
booktitle = {Proceedings of the Thirty-Fourth International Joint Conference on
Artificial Intelligence, {IJCAI-25}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {James Kwok},
pages = {9719--9727},
year = {2025},
month = {8},
note = {AI and Social Good},
doi = {10.24963/ijcai.2025/1080},
url = {https://doi.org/10.24963/ijcai.2025/1080},
}
TY - CPAPER TI - Uncertainty-aware Predict-Then-Optimize Framework for Equitable Post-Disaster Power Restoration AU - Jiang, Lin AU - Yu, Dahai AU - Xu, Rongchao AU - Tang, Tian AU - Wang, Guang T2 - Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence, IJCAI-25 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2025 SP - 9719 EP - 9727 DO - 10.24963/ijcai.2025/1080 UR - https://doi.org/10.24963/ijcai.2025/1080 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: