Proceedings

HARMONY: A Privacy-preserving and Sensor-agnostic Tele-monitoring system

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. AI and Social Good. Pages 9945-9953.

https://doi.org/10.24963/ijcai.2025/1105

Abstract

Global aging necessitates tele-monitoring systems to provide real-time tracking and timely assistance for older adults living independently. While pervasive wireless devices (e.g., CSI, IMU, UWB) enable cost-effective, non-intrusive monitoring, existing systems lack flexibility, limiting their adaptability to different environments. In this work, we posit that the motion dynamics of human movement are invariant across sensing modalities, inspiring the design of HARMONY—a privacy-preserving, sensor-agnostic system that supports multi-modal inputs and diverse tele-monitoring tasks. HARMONY incorporates Modality-agnostic Data Processing to uniformly encrypt multi-modal signals and Task-specific Activity Recognition for seamless tasks adaptation. A novel Encrypted-processing Engine then significantly accelerates computations on encrypted data by optimizing matrix and convolution operations. Evaluations across five different sensing modalities show that HARMONY consistently achieves high accuracy while delivering 3.5 × to 130 × speedups over state-of-the-art baselines. Our results demonstrate that HARMONY is a practical, scalable, and privacy-centric prototype for next-generation remote healthcare.

  1. [Bloom and Luca, 2016] David E Bloom and Dara Lee Luca. The global demography of aging: facts, explanations, fu- ture. In Handbook of the economics of population aging, volume 1, pages 3-56. Elsevier, 2016.
  2. [Brutzkus et al., 2019] Alon Brutzkus, Ran Gilad-Bachrach, and Oren Elisha. Low latency privacy preserving infer- ence. In International Conference on Machine Learning, pages 812-821. PMLR, 2019.
  3. [Cesareo et al., 2018] Ambra Cesareo, Ylenia Previtali, Emilia Biffi, and Andrea Aliverti. Assessment of breathing parameters using an inertial measurement unit (imu)-based system. Sensors, 19(1):88, 2018.
  4. [Chien et al., 2023] Hao-Jen Chien, Hossein Khalili, Amin Hass, and Nader Sehatbakhsh. Enc2: Privacy-preserving inference for tiny iots via encoding and encryption. In Pro- ceedings of the 29th Annual International Conference on Mobile Computing and Networking, pages 1-16, 2023.
  5. [Enshaeifar et al., 2020] Shirin Enshaeifar, Payam Barnaghi, Severin Skillman, David Sharp, Ramin Nilforooshan, and Helen Rostill. A digital platform for remote healthcare monitoring. In Companion Proceedings of the Web Con- ference 2020, pages 203-206, 2020.
  6. [Fernandes et al., 2024] Glenn J Fernandes, Jiayi Zheng, Mahdi Pedram, Christopher Romano, Farzad Shahabi, Blaine Rothrock, Thomas Cohen, Helen Zhu, Tanmeet S Butani, Josiah Hester, et al. Habitsense: A privacy-aware, ai-enhanced multimodal wearable platform for mhealth applications. Proceedings of the ACM on Interactive, Mo- bile, Wearable and Ubiquitous Technologies, 8(3):1-48, 2024.
  7. [Jiang et al., 2024] Siyang Jiang, Xian Shuai, and Guoliang Xing. Artfl: Exploiting data resolution in federated learn- ing for dynamic runtime inference via multi-scale training. In 2024 23rd ACM/IEEE International Conference on In- formation Processing in Sensor Networks (IPSN), pages 27-38. IEEE, 2024. Juvekar et al., 2018] Chiraag Juvekar, Vinod Vaikun- tanathan, and Anantha Chandrakasan. {GAZELLE}: A low latency framework for secure neural network inference. In 27th USENIX security symposium (USENIX security 18), pages 1651-1669, 2018.
  8. [Li et al., 2017] Yi Li, Haozhi Qi, Jifeng Dai, Xiangyang Ji, and Yichen Wei. Fully convolutional instance-aware se- mantic segmentation. In Proceedings of the IEEE confer- ence on computer vision and pattern recognition, pages 2359-2367, 2017.
  9. [Li et al., 2023] Huining Li, Xiaoye Qian, Ruokai Ma, Chen- han Xu, Zhengxiong Li, Dongmei Li, Feng Lin, Ming- Chun Huang, and Wenyao Xu. Therapypal: Towards a privacy-preserving companion diagnostic tool based on digital symptomatic phenotyping. In Proceedings of the 29th Annual International Conference on Mobile Comput- ing and Networking, pages 1-15, 2023.
  10. [Liu et al., 2016] Lili Liu, Eleni Stroulia, Ioanis Nikolaidis, Antonio Miguel-Cruz, and Adriana Rios Rincon. Smart homes and home health monitoring technologies for older adults: A systematic review. International journal of med- ical informatics, 91:44-59, 2016.
  11. [Ma and Yeo, 2010] Kaixue Ma and Kiat Seng Yeo. New ultra-wide stopband low-pass filter using transformed ra- dial stubs. IEEE Transactions on Microwave Theory and Techniques, 59(3):604-611, 2010.
  12. [Ouyang et al., 2021] Xiaomin Ouyang, Zhiyuan Xie, Jiayu Zhou, Jianwei Huang, and Guoliang Xing. Clusterfl: a similarity-aware federated learning system for human ac- tivity recognition. In Proceedings of the 19th Annual In- ternational Conference on Mobile Systems, Applications, and Services, pages 54-66, 2021.
  13. [Ouyang et al., 2024] Xiaomin Ouyang, Xian Shuai, Yang Li, Li Pan, Xifan Zhang, Heming Fu, Sitong Cheng, Xinyan Wang, Shihua Cao, Jiang Xin, et al. Admarker: A multi-modal federated learning system for monitoring dig- ital biomarkers of alzheimer's disease. In Proceedings of the 30th Annual International Conference on Mobile Com- puting and Networking, pages 404-419, 2024.
  14. [Schütz et al., 2022] Narayan Schütz, Samuel EJ Knobel, Angela Botros, Michael Single, Bruno Pais, Valérie Santschi, Daniel Gatica-Perez, Philipp Buluschek, Pra- bitha Urwyler, Stephan M Gerber, et al. A systems ap- proach towards remote health-monitoring in older adults: Introducing a zero-interaction digital exhaust. NPJ digital medicine, 5(1):116, 2022.
  15. [Song et al., 2020] Xingzhe Song, Boyuan Yang, Ge Yang, Ruirong Chen, Erick Forno, Wei Chen, and Wei Gao. Spirosonic: monitoring human lung function via acoustic sensing on commodity smartphones. In Proceedings of the 26th Annual International Conference on Mobile Comput- ing and Networking, pages 1-14, 2020.
  16. [Wang et al., 2014] Guanhua Wang, Yongpan Zou, Zimu Zhou, Kaishun Wu, and Lionel M Ni. We can hear you with wi-fi! In Proceedings of the 20th annual interna- tional conference on Mobile computing and networking, pages 593-604, 2014.
  17. [Wang et al., 2016] Yuxi Wang, Kaishun Wu, and Lionel M Ni. Wifall: Device-free fall detection by wireless networks. IEEE Transactions on Mobile Computing, 16(2):581-594, 2016.
  18. [Wu et al., 2024] Haiyang Wu, Kaiwei Liu, Siyang Jiang, Zhihe Zhao, Zhenyu Yan, and Guoliang Xing. Demo ab- stract: Caringfm: An interactive in-home healthcare sys- tem empowered by large foundation models. In 2024 23rd ACM/IEEE International Conference on Information Pro- cessing in Sensor Networks (IPSN), pages 255-256. IEEE, 2024.
  19. [Xu et al., 2024] Muhao Xu, Zhenfeng Zhu, Youru Li, Shuai Zheng, Yawei Zhao, Kunlun He, and Yao Zhao. Flex- care: Leveraging cross-task synergy for flexible multi- modal healthcare prediction. In Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 3610-3620, 2024.
  20. [Yang et al., 2023a] Jianfei Yang, Xinyan Chen, Han Zou, Chris Xiaoxuan Lu, Dazhuo Wang, Sumei Sun, and Lihua Xie. Sensefi: A library and benchmark on deep-learning- empowered wifi human sensing. Patterns, 4(3), 2023.
  21. [Yang et al., 2023b] Xuanang Yang, Jing Chen, Kun He, Hao Bai, Cong Wu, and Ruiying Du. Efficient privacy- preserving inference outsourcing for convolutional neural networks. IEEE Transactions on Information Forensics and Security, 18:4815-4829, 2023.
  22. [Yang et al., 2024] Bufang Yang, Siyang Jiang, Lilin Xu, Kaiwei Liu, Hai Li, Guoliang Xing, Hongkai Chen, Xiao- fan Jiang, and Zhenyu Yan. Drhouse: An llm-empowered diagnostic reasoning system through harnessing outcomes from sensor data and expert knowledge. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 8(4):1-29, 2024.
  23. [Zhang et al., 2019] Hanbin Zhang, Chen Song, Aosen Wang, Chenhan Xu, Dongmei Li, and Wenyao Xu. Pdvo- cal: Towards privacy-preserving parkinson's disease de- tection using non-speech body sounds. In The 25th an- nual international conference on mobile computing and networking, pages 1-16, 2019.
  24. [Zhang et al., 2021] Qiao Zhang, Chunsheng Xin, and Hongyi Wu. Gala: Greedy computation for linear alge- bra in privacy-preserved neural networks. arXiv preprint arXiv:2105.01827, 2021.
  25. [Zhang et al., 2022] Chaohe Zhang, Xu Chu, Liantao Ma, Yinghao Zhu, Yasha Wang, Jiangtao Wang, and Junfeng Zhao. M3care: Learning with missing modalities in mul- timodal healthcare data. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, pages 2418-2428, 2022.
  26. [Zhang et al., 2024] Bin-Bin Zhang, Dongheng Zhang, Yadong Li, Zhi Lu, Jinbo Chen, Haoyu Wang, Fang Zhou, Yu Pu, Yang Hu, Li-Kun Ma, et al. Monitoring long-term cardiac activity with contactless radio frequency signals. Nature Communications, 15(1):1-11, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards