Confirmatory Bayesian Online Change Point Detection in the Covariance Structure of Gaussian Processes

Confirmatory Bayesian Online Change Point Detection in the Covariance Structure of Gaussian Processes

Jiyeon Han, Kyowoon Lee, Anh Tong, Jaesik Choi

Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence
Main track. Pages 2449-2455. https://doi.org/10.24963/ijcai.2019/340

In the analysis of sequential data, the detection of abrupt changes is important in predicting future events. In this paper, we propose statistical hypothesis tests for detecting covariance structure changes in locally smooth time series modeled by Gaussian Processes (GPs). We provide theoretically justified thresholds for the tests, and use them to improve Bayesian Online Change Point Detection (BOCPD) by confirming statistically significant changes and non-changes. Our Confirmatory BOCPD (CBOCPD) algorithm finds multiple structural breaks in GPs even when hyperparameters are not tuned precisely. We also provide conditions under which CBOCPD provides the lower prediction error compared to BOCPD. Experimental results on synthetic and real-world datasets show that our proposed algorithm outperforms existing methods for the prediction of nonstationarity in terms of both regression error and log-likelihood.
Keywords:
Machine Learning: Time-series;Data Streams
Uncertainty in AI: Uncertainty in AI
Machine Learning: Probabilistic Machine Learning