Proceedings

Adversarial Framework with Certified Robustness for Time-Series Domain via Statistical Features (Extended Abstract)

Download BibTeX Cite

Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence. Journal Track. Pages 6845-6850.

https://doi.org/10.24963/ijcai.2023/767

Abstract

Time-series data arises in many real-world applications (e.g., mobile health) and deep neural networks (DNNs) have shown great success in solving them. Despite their success, little is known about their robustness to adversarial attacks. In this paper, we propose a novel adversarial framework referred to as Time-Series Attacks via STATistical Features (TSA-STAT). To address the unique challenges of time-series domain, TSA-STAT employs constraints on statistical features of the time-series data to construct adversarial examples. Optimized polynomial transformations are used to create attacks that are more effective (in terms of successfully fooling DNNs) than those based on additive perturbations. We also provide certified bounds on the norm of the statistical features for constructing adversarial examples. Our experiments on diverse real-world benchmark datasets show the effectiveness of TSA-STAT in fooling DNNs for time-series domain and in improving their robustness.

  1. [Aminikhanghahi et al., 2018] Samaneh Aminikhanghahi, Tinghui Wang, and Diane J Cook. Real-time change point detection with application to smart home time series data. IEEE Transactions on Knowledge and Data Engineering, 31(5):1010-1023, 2018.
  2. [Athalye et al., 2018] Anish Athalye, Logan Engstrom, An- drew Ilyas, and Kevin Kwok. Synthesizing robust adver- sarial examples. In Proceedings of the 35th International Conference on Machine Learning (ICML, 2018.
  3. [Bagnall et al., 2020] Anthony Bagnall, Jason Lines, William Vickers, and Eamonn Keogh. The UEA & UCR time series classification rep. www.timeseriesclassification.com, 2020. Accessed: 2020-01-01.
  4. [Belkhouja and Doppa, 2020] Taha Belkhouja and Janard- han Rao Doppa. Analyzing deep learning for time-series data through adversarial lens in mobile and iot applica- tions. IEEE Transactions on Computer Aided Design of Integrated Circuits and Systems (TCAD), 39(11):3190- 3201, 2020.
  5. [Belkhouja and Doppa, 2022] Taha Belkhouja and Janard- han Rao Doppa. Adversarial framework with certified robustness for time-series domain via statistical features. Journal of Artificial Intelligence Research, 73:1435-1471, 2022.
  6. [Belkhouja et al., 2022] Taha Belkhouja, Yan Yan, and Ja- nardhan Rao Doppa. Training robust deep models for time-series domain: Novel algorithms and theoretical analysis. In AAAI Conference on Artificial Intelligence (AAAI), 2022.
  7. [Belkhouja et al., 2023] Taha Belkhouja, Yan Yan, and Ja- nardhan Rao Doppa. Dynamic time warping based ad- versarial framework for time-series domain. IEEE Trans- actions on Pattern Analysis and Machine Intelligence (TPAMI), 2023.
  8. [Carlini and Wagner, 2017] Nicholas Carlini and David Wagner. Towards evaluating the robustness of neural networks. In IEEE Symposium on Security and Privacy (SP), 2017.
  9. [Chen and Gu, 2020] Jinghui Chen and Quanquan Gu. Rays: A ray searching method for hard-label adversarial attack. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, 2020.
  10. [Chen et al., 2020] Jinghui Chen, Dongruo Zhou, Jinfeng Yi, and Quanquan Gu. A frank-wolfe framework for efficient and effective adversarial attacks. Proceedings of the AAAI Conference on Artificial Intelligence, 2020.
  11. [Christ et al., 2016] Maximilian Christ, Andreas W Kempa- Liehr, and Michael Feindt. Distributed and parallel time series feature extraction for industrial big data applica- tions. arXiv preprint arXiv:1610.07717, 2016.
  12. [Cohen et al., 2019] Jeremy M Cohen, Elan Rosenfeld, and J Zico Kolter. Certified adversarial robustness via random- ized smoothing. arXiv preprint arXiv:1902.02918, 2019.
  13. [Drensky and Holtkamp, 2006] Vesselin Drensky and Ralf Holtkamp. Constants of formal derivatives of non- associative algebras, taylor expansions and applica- tions. Rendiconti del Circolo Matematico di Palermo, 55(3):369-384, 2006.
  14. [Dua and Graff, 2017] Dheeru Dua and Casey Graff. UCI machine learning repository. http://archive.ics.uci.edu/ml, 2017. Accessed: 2020-01-01. Link
  15. [Fawaz et al., 2019] Hassan Ismail Fawaz, Germain Forestier, Jonathan Weber, Lhassane Idoumghar, and Pierre-Alain Muller. Adversarial attacks on deep neural networks for time series classification. International Joint Conference on Neural Networks (IJCNN), 2019.
  16. [Fulcher and Jones, 2014] Ben D Fulcher and Nick S Jones. Highly comparative feature-based time-series classifica- tion. IEEE Transactions on Knowledge and Data Engi- neering, 2014.
  17. [Gao et al., 2018] Ji Gao, Jack Lanchantin, Mary Lou Soffa, and Yanjun Qi. Black-box generation of adversarial text sequences to evade deep learning classifiers. In IEEE Se- curity and Privacy Workshops (SPW), pages 50-56, 2018.
  18. [Ge and Ge, 2016] Li Ge and Li-Juan Ge. Feature extraction of time series classification based on multi-method inte- gration. Optik, 127(23):11070-11074, 2016.
  19. [Hein and Andriushchenko, 2017] Matthias Hein and Maksym Andriushchenko. Formal guarantees on the robustness of a classifier against adversarial manipulation. In Advances in Neural Information Processing Systems, pages 2266-2276, 2017.
  20. [Hosseini et al., 2017] Hossein Hosseini, Baicen Xiao, May- oore Jaiswal, and Radha Poovendran. On the limitation of convolutional neural networks in recognizing negative im- ages. In 16th International Conference on Machine Learn- ing and Applications (ICMLA). IEEE, 2017.
  21. [Huang et al., 2017] Xiaowei Huang, Marta Kwiatkowska, Sen Wang, and Min Wu. Safety verification of deep neural networks. In International conference on computer aided verification, pages 3-29. Springer, 2017.
  22. [Hussein et al., 2022] Dina Hussein, Taha Belkhouja, Gana- pati Bhat, and Janardhan Rao Doppa. Reliable machine learning for wearable activity monitoring: Novel algo- rithms and theoretical guarantees. In Proceedings of the 41st IEEE/ACM International Conference on Computer- Aided Design (ICCAD), pages 33:1-33:9. ACM, 2022.
  23. [Ignatov, 2018] Andrey Ignatov. Real-time human activity recognition from accelerometer data using convolutional neural networks. Applied Soft Computing, 62:915-922, 2018.
  24. [Karim et al., 2020] Fazle Karim, Somshubra Majumdar, and Houshang Darabi. Adversarial attacks on time series. IEEE Transactions on pattern analysis and machine intel- ligence, 2020.
  25. [Kolter and Madry, 2018] Zico Kolter and Aleksander Madry. Tutorial adversarial robustness: Theory and practice. NeurIPS, 2018.
  26. [Kurakin et al., 2016] Alexey Kurakin, Ian Goodfellow, and Samy Bengio. Adversarial examples in the physical world. arXiv preprint arXiv:1607.02533, 2016.
  27. [Kwapisz et al., 2011] Jennifer R Kwapisz, Gary M Weiss, and Samuel A Moore. Activity recognition using cell phone accelerometers. SigKDD Explorations Newsletter, 12(2):74-82, 2011.
  28. [Laidlaw and Feizi, 2019] Cassidy Laidlaw and Soheil Feizi. Functional adversarial attacks. In Advances in Neural In- formation Processing Systems (Neur'IPS), pages 10408- 10418, 2019.
  29. [Li et al., 2019] Bai Li, Changyou Chen, Wenlin Wang, and Lawrence Carin. Certified adversarial robustness with ad- ditive noise. In Advances in Neural Information Process- ing Systems, pages 9459-9469, 2019.
  30. [Luo et al., 2018] Yonghong Luo, Xiangrui Cai, Ying ZHANG, Jun Xu, and Yuan xiaojie. Multivariate time series imputation with generative adversarial networks. In S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett, editors, Advances in Neural Information Processing Systems (NeurIPS). Cur- ran Associates, Inc., 2018.
  31. [Luo et al., 2019] Yonghong Luo, Ying Zhang, Xiangrui Cai, and Xiaojie Yuan. E²gan: End-to-end generative ad- versarial network for multivariate time series imputation. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI-19, 2019. IJCAI
  32. [Maaten and Hinton, 2008] Laurens van der Maaten and Ge- offrey Hinton. Visualizing data using t-sne. Journal of Machine Learning Research (JMLR), 9(Nov):2579-2605, 2008.
  33. [Madry et al., 2017] Aleksander Madry, Aleksandar Makelov, Ludwig Schmidt, Dimitris Tsipras, and Adrian Vladu. Towards deep learning models resistant to adversarial attacks. arXiv preprint arXiv:1706.06083, 2017.
  34. [Montgomery et al., 2015] Douglas C Montgomery, Cheryl L Jennings, and Murat Kulahci. Introduction to time series analysis and forecasting. John Wiley & Sons, 2015.
  35. [Moosavi-Dezfooli et al., 2017] Seyed-Mohsen Moosavi- Dezfooli, Alhussein Fawzi, Omar Fawzi, and Pascal Frossard. Universal adversarial perturbations. In Pro- ceedings of the IEEE conference on computer vision and pattern recognition (CVPR), 2017.
  36. [Ozbayoglu et al., 2020] Ahmet Murat Ozbayoglu, Mehmet Ugur Gudelek, and Omer Berat Sezer. Deep learning for financial applications: A survey. arXiv preprint arXiv:2002.05786, 2020.
  37. [Papernot et al., 2017] Nicolas Papernot, Patrick McDaniel, Ian Goodfellow, Somesh Jha, Z Berkay Celik, and Anan- thram Swami. Practical black-box attacks against machine learning. In Proceedings of Asia Conference on Computer and Communications Security (ASIACCS). ACM, 2017.
  38. [Raghunathan et al., 2018] Aditi Raghunathan, Jacob Stein- hardt, and Percy Liang. Certified defenses against adver- sarial examples. arXiv preprint arXiv:1801.09344, 2018.
  39. [Samanta and Mehta, 2017] Suranjana Samanta and Sameep Mehta. Towards crafting text adversarial samples. arXiv preprint arXiv:1707.02812, 2017.
  40. [Siddiqui et al., 2019] Shoaib Ahmed Siddiqui, Dominique Mercier, Mohsin Munir, Andreas Dengel, and Sheraz Ahmed. TSViz: Demystification of deep learning mod- els for time-series analysis. IEEE Access, 7:67027-67040, 2019.
  41. [Tramèr et al., 2018] Florian Tramèr, Alex Kurakin, Nicolas Papernot, Ian Goodfellow, Dan Boneh, and Patrick Mc- Daniel. Ensemble adversarial training: Attacks and de- fenses. International Conference on Learning Represen- tations (ICLR), 2018.
  42. [Tramer et al., 2020] Florian Tramer, Nicholas Carlini, Wieland Brendel, and Aleksander Madry. On adaptive attacks to adversarial example defenses. arXiv preprint arXiv:2002.08347, 2020.
  43. [Wang et al., 2017] Zhiguang Wang, Weizhong Yan, and Tim Oates. Time series classification from scratch with deep neural networks: A strong baseline. In International Joint Conference on Neural Networks (IJCNN). IEEE, 2017.
  44. [Wang et al., 2019] William Yang Wang, Sameer Singh, and Jiwei Li. Deep adversarial learning for nlp. In Proceed- ings of the Conference of the NAACL: Tutorials, pages 1- 5, 2019.
  45. [Xiao et al., 2018] Chaowei Xiao, Jun-Yan Zhu, Bo Li, Warren He, Mingyan Liu, and Dawn Song. Spa- tially transformed adversarial examples. arXiv preprint arXiv:1801.02612, 2018.
  46. [Zheng et al., 2017] Zibin Zheng, Yatao Yang, Xiangdong Niu, Hong-Ning Dai, and Yuren Zhou. Wide and deep con- volutional neural networks for electricity-theft detection to secure smart grids. IEEE Transactions on Industrial Infor- matics, 2017.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards