Together about Dementia
Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence. Demo Track. Pages 5888-5891.
https://doi.org/10.24963/ijcai.2022/846
Keywords
- Multidisciplinary Topics and Applications: Health and Medicine
- Data Mining: Applications
- Data Mining: Parallel, Distributed and Cloud-based High Performance Mining
- Data Mining: Frequent Pattern Mining
- Data Mining: Anomaly/Outlier Detection
Abstract
We present ``Together about Dementia'', a mobile health app
that aims to help persons with dementia when they get lost through
the help of caregivers, relatives, and volunteering
citizens. When the app detects that a person with dementia is
disoriented, wandering, and getting lost, it triggers an alarm that
activates a relative and possibly a volunteer in the proximity. A
backend system based on a microservice and serverless architecture
performs the detection of wandering and the subsequent coordination
of users that are put on a mission to the rescue of the person with
dementia. The backend system implements an AI technique for
spatio-temporal anomaly detection based on location data recorded by
the frontend system installed on the portable device of the person
with dementia.
- [Alharbi et al., 2019] Shooq Alharbi, Aisha Altamimi, Fadwa Al-Qahtani, Bashair Aljofi, Mutasem Alsmadi, Muneerah Alshabanah, Daniah Alrajhi, and Ibrahim Almarashdeh. Analyzing and implementing a mobile reminder system for alzheimer's patients. Interna- tional Research Journal of Engineering and Technology, 6:444-454, 6 2019.
- [Aljehani et al., 2018] Shahad Saud Aljehani, Rahaf Abdu- laziz Alhazmi, Sara Saleh Aloufi, Bushra Difalla Aljehani, and Ruqayya Abdulrahman. icare: Applying iot technol- ogy for monitoring alzheimer's patients. In 2018 1st Inter- national Conference on Computer Applications Informa- tion Security (ICCAIS), pages 1-6, 2018.
- [Andersen et al., 2021a] Nicklas Sindlev Andersen, Marco Chiarandini, Stefan Jänicke, Panagiotis Tampakis, and Arthur Zimek. Detecting wandering behavior of peo- ple with dementia. In 2021 International Conference on Data Mining, ICDM 2021 -Workshops, Auckland, New Zealand, December 7-10, 2021, pages 727-733. IEEE, 2021.
- [Andersen et al., 2021b] Nicklas Sindlev Andersen, Marco Chiarandini, and Jacopo Mauro. Wandering and getting lost: the architecture of an app activating local commu- nities on dementia issues. In 3rd IEEE/ACM Interna- tional Workshop on Software Engineering for Healthcare, SEH@ICSE 2021, Madrid, Spain, June 3, 2021, pages 36- 43. IEEE, 2021.
- [Andersen, 2021] Nicklas Sindlev Andersen. Sammen Om Demens (SOD) backend snapshot (version v1). https://do i.org/10.5281/zenodo.4597416, 2021. Accessed: 08-03- 2021. DOI
- [Brown and O'Connor, 2020] Andrew Brown and Siobhan O'Connor. Mobile health applications for people with dementia: a systematic review and synthesis of quali- tative studies. Informatics for Health and Social Care, 45(4):343-359, 2020.
- [Cenci et al., 2022] Alessandra Cenci, Susanne Jackobsen Ilskov, Nicklas Sindlev Andersen, and Marco Chiarandini. The value-sensitive design of a smartphone app targeting citizens with dementia in a danish municipality. To be sub- mitted to Journal of Science and Engineering Ethics, 2022.
- [Django REST, 2020] Django rest framework. https://www. django-rest-framework.org, 2020. Accessed: 22-12-2020. Link
- [Ghanem and Alkhal, 2018] Amal Saleh Ghanem and Hamad Ameer Alkhal. A mobile cloud-based system for alzheimer's disease. In 2018 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT), pages 1-5, 2018.
- [Gupta et al., 2019] Gaurav Gupta, Ankit Gupta, Parimita Barura, and Varun Jaiswal. Mobile health applications and android toolkit for alzheimer patients, caregivers and doc- tors. Biological Forum, pages 199-205, 07 2019.
- [Kim et al., 2021] Eunhee Kim, Andrius Baskys, Anandi V. Law, Moom R. Roosan, Yan Li, and Don Roosan. Scop- ing review: the empowerment of alzheimer's disease care- givers with mhealth applications. NPJ digital medicine, 4(1):131, 2021. [OpenFaaS, 2020] Openfaas. https://www.openfaas.com, 2020. Accessed: 01-05-2022. Link
- [Pei et al., 2001] Jian Pei, Jiawei Han, Behzad Mortazavi- Asl, Helen Pinto, Qiming Chen, Umeshwar Dayal, and Mei-Chun Hsu. Prefixspan: mining sequential patterns ef- ficiently by prefix-projected pattern growth. In Proceed- ings 17th International Conference on Data Engineering, pages 215-224, 2001.
- [Richardson, 2021a] Chris Richardson. Pattern: Microser- vice architecture. https://microservices.io/patterns/micros ervices.html, 2021. Accessed: 25-02-2021. Link
- [Richardson, 2021b] Chris Richardson. Pattern: Serverless deployment. https://microservices.io/patterns/deployment /serverless-deployment.html, 2021. Accessed: 25-02- 2021. Link
- [Siddiq et al., 2018] Kainat Siddiq, Narmeen Bawany, Tehreem Qamar, Ayesha Naveed, Bisma Arif, Mariam Usman, and Mehek Jamal. Cared: Non-pharmacological assistance for dementia patients. EAI Endorsed Trans- actions on Pervasive Health and Technology, 4(16), 2018.
- [Stutzel et al., 2016] Matheus Costa Stutzel, Michel Fillipo, Alexandre Sztajnberg, André Brittes, and Luciana Branco da Motta. Smai -mobile system for elderly monitoring. In 2016 IEEE International Conference on Serious Games and Applications for Health (SeGAH), pages 1-8, 2016.
- [Surendran and Rohinia, 2019] Doraiswamy Surendran and Murugesan Rohinia. BLE bluetooth beacon based solution to monitor egress of alzheimer's disease sufferers from in- doors. Procedia Computer Science, 165:591-597, 2019.
- [Vergara et al., 2015] Jeisson A. Vergara, Yesika M. Ramírez, and Jorge E. Camargo. A pervasive and ubiquitous mobile health application for tracking people with disabilities. In 2015 10th Computing Colombian Conference (10CCC), pages 206-213, 2015.
- [WHO, 2011] mhealth: New horizons for health through mobile technologies. https://www.who.int/goe/publicatio ns/goe mhealth web.pdf, December 2011. Accessed: 10- 02-2022. Link
- [WHO, 2021] Dementia. https://www.who.int/news-room/ fact-sheets/detail/dementia, September 2021. Accessed: 10-02-2022. Link
- [Yousaf et al., 2020] Kanwal Yousaf, Zahid Mehmood, Is- rar Ahmad Awan, Tanzila Saba, Riad Alharbey, Talal Qadah, and Mayda Abdullateef Alrige. A comprehen- sive study of mobile-health based assistive technology for the healthcare of dementia and alzheimer's disease (ad). Health Care Management Science, 23:287-309, 2020.
References were extracted automatically from the PDF and may contain errors.
Full text extracted automatically from the PDF; figures, tables and equations may differ. The PDF is the version of record.
1 Introduction andMotivation
The number of people diagnosed with dementia each year is increasing [WHO, 2021]. This is primarily due to the fact that age is the most important risk factor for dementia syndrome and that the worldwide population is aging. As dementia progress and cognitive abilities decline, the persons affected may need to rely increasingly on caregivers and relatives for support. This puts pressure on caregivers and relatives. To alleviate it and to improve the quality of life of persons with dementia (PwD), mobile health (mHealth) devices and applications within dementia care are increasingly being used to support caregivers and relatives in various tasks and enhance the well-being of PwD.
The World Health Organization (WHO) defines mHealth as "the use of mobile and wireless devices to improve health outcomes, healthcare services, and research" [WHO, 2011]. Research on mHealth applications for dementia patients and their caregivers has been conducted in a fair amount [Brown and O'Connor, 2020; Yousaf et al., 2020; Kim et al., 2021]. One of the most identifiable symptoms of dementia is forgetfulness and memory loss. PwD are thus at risk of wandering and getting lost. mHealth apps and devices for tracking and monitoring a PwD's location have thus been described in several studies [Vergara et al., 2015; Aljehani et al., 2018; Ghanem and Alkhal, 2018; Siddiq et al., 2018; Alharbi et al.,
2019; Gupta et al., 2019; Stutzel et al., 2016; Surendran and Rohinia, 2019]. These studies describe mHealth apps and devices with the functionality of tracking the PwD's current location. Among these apps, three of them [Vergara et al., 2015; Ghanem and Alkhal, 2018; Surendran and Rohinia, 2019] include an alert system for caregivers and relatives.
We go beyond the mere monitoring of the current location of a PwD and present "Sammen Om Demens" (together about dementia, SOD), an app that aims at automatically detecting if a person is wandering and, in case, trigger a rescue operation. SOD is developed for the local community of the Danish municipality of Nyborg, who together with TrygFonden provided financial support. A participatory design approach was used in the conception phase of SOD and in the later stages of user testing. The final outcome is an app that accommodates three user types: i) users with dementia (from light to medium cases) who can use to a certain degree a smartphone and remember to bring it with them; ii) closest caregivers and relatives linked to one or more users with dementia; and iii) ordinary citizens not linked to any specific user who volunteer to help in situations of wandering. Relatives to a PwD are handled as volunteers but have enhanced functionalities towards the PwD to whom they are linked.
For the final users, the app consists of three components, each providing a different functionality: a knowledge base (managed through a content management system) providing information about the local offer for PwD by the municipality, a help component providing functionalities to activate relatives and near volunteers in cases of need, and a recreational activity calendar to facilitate social gatherings, including an additional feature (currently inactive) to find accompanying persons.
AI techniques are used to detect whether a PwD exhibits an anomalous behavior consisting of wandering, which is interpreted as a sign of becoming lost or being confused about the location.
The help component offers to a PwD who is feeling lost or confused about the location the possibility to directly trigger an alarm to call for assistance by the nearest relative or volunteer. The alarm initiates a mission whose management has been carefully designed to guarantee a trustful process. Relatives are engaged in this process and coordinate the intervention by one of the nearest volunteers through a call. Further, the address of the PwD is not unveiled to the volunteers, but they are requested to help the PwD reach a safe place, e.g., a care home, a police station, or the like. Alternatively, an alarm can be triggered by a relative linked to a PwD who detects an anomalous wandering of their PwD by means of their exclusive tracking capability that monitors the trajectories of users on a map. In this case, the mission starts with a call from the relatives to their PwD to assess the situation and in case activating volunteers, if necessary. Most interestingly, the same alarm can also be triggered automatically by the app if the AI engine in the backend system detects in the PwD an anomalous behavior of wandering from the stream of location data sent by the frontend.
In all cases, if a mission is actively or automatically triggered, the backend system has the task of sending out a call to the available relative of the PwD and notifications to the three nearest available volunteers. If there is more than one relative, the one registered with the highest priority is chosen. When the notification is received on a device of a volunteer, it triggers an alarm sound to warn the user to react fast. The volunteers that receive the notification can see the location of the PwD and can accept or decline the request for help. When the PwD has been brought to a safe place, the mission is closed by one of the relatives. Protocols are also available for cases where the relative does not respond to the call or the volunteers do not accept to help the PwD. Finally, if no one can help the PwD, the PwD will automatically be prompted to contact emergency services instead.
The development of SOD brought the following novelties and contributions to mHealth.
- The app is the result of a participatory design approach, a process in which all stakeholders (PwD, relatives, nurses, administrative people, volunteers, AI experts, and developers) have been involved in workshops and tests [Cenci et al., 2022]. In particular, this approach has determined the components of the app, the final protocol for the management of a mission, and the communication means in the frontend.
- The design and implementation of an architecture made of a frontend and a backend that use microservices and serverless services to facilitate scalability, maintenance, and continuous refinements of the AI engine [Andersen et al., 2021b].
- The design and testing of AI algorithms for anomaly detection in spatio-temporal data [Andersen et al., 2021a].
We make available: a demonstration video at https://vime o.com/677269330, a dissemination web-page at https://sod. sdu.dk, and the code-base and test data [Andersen, 2021].
2 AutomaticWandering Detection
We set focus on the current AI engine of SOD described more thoroughly in [Andersen et al., 2021a]. The engine is based on past, and real-time location data transmitted by the device of a PwD and relies on personalized models.
Overall the engine consists of two components: one periodic and one real-time. The task of the periodic component is to extract typical historical movement patterns of a PwD from continuously incoming location data points, while the real-time component compares the current pattern with the typical ones to detect significant deviations.


The periodic processing of collected location data is illustrated in Figure 1. The continuous stream of data is decomposed into movement trajectories by determining geographical regions in which the person had prolonged stays. Thus trajectories have geographical regions as origins and destinations. The trajectories are then transformed into sequences of geohashes, which are unique strings to which geospatial coordinates that fall within a grid are mapped. Finally, a set of frequent sequential patterns is extracted via the PrefixSpan algorithm [Pei et al., 2001]. This helps summarize the collected data and organize past trajectories in frequent sequence patterns between different origins and destinations.
The real-time processing of location data is illustrated in Figure 2. Here, we assume available a database D of the typical geohash sequences of a PwD. For an on-going trajectory T ′ , the same segmenting and transformation process as in the periodic component is applied, yielding a partial geohash sequence Vi = [v0, v1, . . . , vi]. Whenever a new element vi+1 is added, a similarity score can be calculated between Vi+1 and the elements of D, that is, si+1 = f(U,Vi+1)/|Vi+1|. The score si+1 uses a sequence alignment function f that counts how many elements of the best matching sequence U ∈ D align with the elements of the on-going sequence Vi+1. From si+1 an anomaly score ai+1 = 1 -minj=0,...,i+1 (sj) can be updated and monitored. If this score rises above a threshold θ ∈ (0, 1], then the trajectory is classified as anomalous, and an alarm procedure is triggered. Clearly, the proper setting of the parameter θ is crucial for the approach [Andersen et al., 2021a].
3 SystemArchitecture
The implementation of the backend has to adhere to efficiency, reliability and maintainability requirements. We chose to use a lightweight Kubernetes distribution called k3s to deploy and run the different elements needed by the help component as microservices or serverless functions. These types of architectural components especially have advantages with respect to efficiency, reliability, and maintainability [Richardson, 2021a; Richardson, 2021b] when deployed to a platform like Kubernetes.
Microservices and serverless functions are architectural components that handle a limited set of tasks. They promote the logical grouping of elements into separate components that use their own isolated environment and are loosely coupled with other components. These characteristics facilitate debugging and maintainability, which are important in our case. Our architecture is illustrated in Figure 3. A key component is Redis, which is used as a message queue and broker in handling the internal communication among the other components. Redis is also a part of the communication layer that enables users of the SOD frontend application to establish a persistent connection for bi-directional real-time messaging with the backend system. Redis essentially enables the possibility of passing relevant messages from one user to another through the backend system.
The implementation of the automatic wandering detection engine is delegated to a microservice developed using the Python Django REST framework [Django REST, 2020]. This component offloads most data processing tasks to serverless functions in the OpenFaaS computing framework [OpenFaaS, 2020] via the OpenFaaS Gateway. In the context of the periodic and real-time processing of location data, OpenFaaS provides a platform for scaling CPU-bound computations implemented as functions.
The Django component also takes care of managing a mission when wandering is detected in a PwD. In particular, the component implements the message flow illustrated in Figure 4. It entails keeping track of the location coordinates of different users (caregivers, relatives, and volunteers) and determining their availability. The component is also responsible for keeping track of the state of the mission at each user and calling the appropriate messages and user interfaces implemented by the frontend. See the linked demonstration video for an example.
4 Conclusion and FutureWork
We have implemented a mHealth application for the involvement of citizens in the care of people with early stages of dementia. The app's main functionality uses AI to detect whether a person is wandering, disoriented, and lost and activate a rescue mission.
SOD has only been tested in synthetic settings at the time of writing. In particular, the automatic wandering detection engine has been tested and compared with an alternative approach from the literature on synthetically generated data


[Andersen et al., 2021a]. Similarly, the scalability and reliability of the architecture have undergone synthetical load tests [Andersen et al., 2021b]. User tests in protected environments have been accomplished at many stages. We are in the process of launching the app on a restricted set of users to closely monitor the performance. The next step will be the assessment of real-life rescue mission episodes 1 .
1 We acknowledge financial support for the SOD project by TrygFonden (ID 127211), Nyborg Kommune and the University of Southern Denmark.
@inproceedings{ijcai2022p846,
title = {Together about Dementia},
author = {Andersen, Nicklas Sindlev and Chiarandini, Marco},
booktitle = {Proceedings of the Thirty-First International Joint Conference on
Artificial Intelligence, {IJCAI-22}},
publisher = {International Joint Conferences on Artificial Intelligence Organization},
editor = {Luc De Raedt},
pages = {5888--5891},
year = {2022},
month = {7},
note = {Demo Track},
doi = {10.24963/ijcai.2022/846},
url = {https://doi.org/10.24963/ijcai.2022/846},
}
TY - CPAPER TI - Together about Dementia AU - Andersen, Nicklas Sindlev AU - Chiarandini, Marco T2 - Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence, IJCAI-22 PB - International Joint Conferences on Artificial Intelligence Organization PY - 2022 SP - 5888 EP - 5891 DO - 10.24963/ijcai.2022/846 UR - https://doi.org/10.24963/ijcai.2022/846 ER -Copied
Machine-readable versions of this paper, for tools and AI agents: