Proceedings

The Role of Perception, Acceptance, and Cognition in the Usefulness of Robot Explanations

Download BibTeX Cite

Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence. Human-Centred AI. Pages 7868-7876.

https://doi.org/10.24963/ijcai.2024/871

Abstract

It is known that when interacting with explainable autonomous systems, user characteristics are important in determining the most appropriate explanation, but understanding which user characteristics are most relevant to consider is not simple. This paper explores such characteristics and analyses how they affect the perceived usefulness of four types of explanations based on the robot's mental states. These types are belief, goal, hybrid (goal and belief) and baseline explanations.

In this study, the explanations were evaluated in the context of a domestic service robot. The user characteristics considered are the perception of the robot's rationality and autonomy, the acceptance of the robot and the user's cognitive tendencies.

We found differences in perceived usefulness between explanation types based on user characteristics, with hybrid explanations being the most useful.

  1. [Abdul et al., 2018] Ashraf Abdul, Jo Vermeulen, Danding Wang, Brian Y Lim, and Mohan Kankanhalli. Trends and trajectories for explainable, accountable and intelligi- ble systems: An hci research agenda. In CHI, pages 1-18, 2018.
  2. [Anderson et al., 2021] Andrew Anderson, Tianyi Li, Mi- haela Vorvoreanu, and Margaret Burnett. Human-ai in- teraction for diverse humans: What cognitive style disag- gregation reveals. arXiv preprint arXiv:2108.00588, 2021.
  3. [Buttrick and et al, 2019] Nicholas Buttrick and et al. Cross- Cultural Consistency and Relativity in the Enjoyment of Thinking Versus Doing. Journal of Personality and Social Psychology, 117(5):71-83, 2019.
  4. [Cacioppo and Petty, 1982] John T. Cacioppo and Richard E. Petty. The need for cognition. Journal of Personality and Social Psychology, 42:116-131, 1982.
  5. [Chanseau et al., 2016] Adeline Chanseau, Kerstin Dauten- hahn, Kheng Lee Koay, and Maha Salem. Who is in charge? sense of control and robot anxiety in human-robot interaction. In 2016 25th IEEE RO-MAN, pages 743-748, 2016.
  6. [Choi et al., 2007] Incheol Choi, Minkyung Koo, and Jong An Choi. Individual differences in analytic versus holistic thinking. Personality and Social Psychology Bul- letin, 33(5):691-705, 2007.
  7. [Conati et al., 2021] Cristina Conati, Oswald Barral, Vanessa Putnam, and Lea Rieger. Toward personal- ized XAI: A case study in intelligent tutoring systems. Artificial Intelligence, 298:103503, 2021.
  8. [De Graaf and Ben Allouch, 2013] Maartje M.A. De Graaf and Somaya Ben Allouch. The relation between people's attitude and anxiety towards robots in human-robot inter- action. In 2013 IEEE RO-MAN, pages 632-637, 2013.
  9. [De Graaf and Malle, 2017] Maartje M.A. De Graaf and Bertram F. Malle. How people explain action (and au- tonomous intelligent systems should too). AAAI Fall Sym- posium, pages 19-26, 2017.
  10. [De Graaf and Malle, 2019] Maartje M.A. De Graaf and Bertram F. Malle. People's Explanations of Robot Be- havior Subtly Reveal Mental State Inferences. ACM/IEEE HRI, 2019-March:239-248, 2019.
  11. [Ferreira and Monteiro, 2020] Juliana Ferreira and Mateus Monteiro. What Are People Doing About XAI User Expe- rience? A Survey on AI Explainability Research and Prac- tice. In Design, User Experience, and Usability. Design for Contemporary Interactive Environments, pages 56-73, Cham, 2020.
  12. [Ferrer et al., 2021] Xavier Ferrer, Tom van Nuenen, Jose Such, Mark Cote, and Natalia Criado. Bias and discrimi- nation in ai: a cross-disciplinary perspective. IEEE Tech- nology and Society, 20(2):72-80, 2021.
  13. [Harbers et al., 2010a] Maaike Harbers, Joost Broekens, Karel Van Den Bosch, and John Jules Meyer. Guidelines for developing explainable cognitive models. In ICCM, pages 85-90, 2010.
  14. [Harbers et al., 2010b] Maaike Harbers, Karel Van Den Bosch, and John Jules Meyer. Design and evaluation of explainable BDI agents. IEEE/WIC/ACM IAT, 2:125-132, 2010.
  15. [Harbers et al., 2017] Maaike Harbers, Marieke MM Peeters, and Mark A Neerincx. Perceived autonomy of robots: effects of appearance and context. In A World with Robots: International Conference on Robot Ethics: ICRE 2015, pages 19-33. Springer, 2017.
  16. [Hauser and Schwarz, 2016] David J Hauser and Norbert Schwarz. Attentive turkers: Mturk participants perform better on online attention checks than do subject pool par- ticipants. Behavior research methods, 48:400-407, 2016.
  17. [Heerink et al., 2009] Marcel Heerink, Ben Kröse, Vanessa Evers, and Bob Wielinga. Measuring acceptance of an assistive social robot: A suggested toolkit. IEEE Inter- national Workshop on Robot and Human Interactive Com- munication, pages 528-533, 2009.
  18. [Kaptein et al., 2017] Frank Kaptein, Joost Broekens, Koen Hindriks, and Mark Neerincx. Personalised self- explanation by robots: The role of goals versus beliefs in robot-action explanation for children and adults. RO- MAN, pages 676-682, 2017.
  19. [Kim et al., 2019] Yujin Kim, Jennifer Dykema, John Stevenson, Penny Black, and D. Paul Moberg. Straightlin- ing: Overview of measurement, comparison of indicators, and effects in mail-web mixed-mode surveys. Social Sci- ence Computer Review, 37(2):214-233, 2019.
  20. [Kopecka et al., 2024] Hana Kopecka, Jose Such, and Michael Luck. Preferences for ai explanations based on cognitive style and socio-cultural factors. Procs. of the ACM on Human-Computer Interaction, 8(CSCW1):1-32, 2024.
  21. [Lee and Sabanović, 2014] Hee Rin Lee and Selma Sa- banović. Culturally variable preferences for robot design and use in south korea, turkey, and the united states. In HRI, page 17-24. ACM, 2014.
  22. [Lee et al., 2012] Hee Rin Lee, JaYoung Sung, Selma Šabanović, and Joenghye Han. Cultural design of domes- tic robots: A study of user expectations in korea and the united states. In IEEE RO-MAN, pages 803-808, 2012.
  23. [Malle and Knobe, 1997] Bertram F. Malle and Joshua Knobe. The folk concept of intentionality. Journal of Ex- perimental Social Psychology, 33(2):101-121, 1997.
  24. [Malle, 1999] Bertram F Malle. How People Explain Be- havior: A New Theoretical Framework. Personality and Social Psychology Review, 3(1):23-48, 1999.
  25. [Malle, 2011] Bertram F. Malle. Time to give up the dogmas of attribution. an alternative theory of behavior explana- tion. In Advances in experimental social psychology, vol- ume 44, pages 297-352. Elsevier, 2011.
  26. [Martín-Fernández et al., 2022] Manuel Martín-Fernández, Blanca Requero, Xiaozhou Zhou, Dilney Gonc ¸alves, and David Santos. Refinement of the Analysis-Holism Scale: A cross-cultural adaptation and validation of two short- ened measures of analytic versus holistic thinking in Spain and the United States. Personality and Individual Differ- ences, 186(February), 2022.
  27. [Masuda and Nisbett, 2001] Takahiko Masuda and Richard E. Nisbett. Attending Holistically Versus Analytically: Comparing the Context Sensitivity of Japanese and Americans. Journal of Personality and Social Psychology, 81(5):922-9343, 2001.
  28. [Millecamp et al., 2019] Martijn Millecamp, Nyi Nyi Htun, Cristina Conati, and Katrien Verbert. To explain or not to explain: The effects of personal characteristics when ex- plaining music recommendations. In IUI, page 397-407, 2019.
  29. [Millecamp et al., 2020] Martijn Millecamp, Robin Have- neers, and Katrien Verbert. Cogito ergo quid? the Effect of Cognitive Style in a Transparent Mobile Music Recom- mender System. In UMAP, pages 323-327, 2020.
  30. [Miller, 2019] Tim Miller. Explanation in artificial intelli- gence: Insights from the social sciences. Artificial Intelli- gence, 267:1-38, 2019.
  31. [Mohseni et al., 2018] Sina Mohseni, Niloofar Zarei, and Eric D. Ragan. A multidisciplinary survey and framework for design and evaluation of explainable ai systems. ACM Trans. Interact. Intell. Syst., 11(3-4), aug 2018.
  32. [Nomura et al., 2008] Tatsuya Nomura, Takayuki Kanda, Tomohiro Suzuki, and Kensuke Kato. Prediction of human behavior in human-robot interaction using psychological scales for anxiety and negative attitudes toward robots. IEEE Trans. on Robotics, 24(2):442-451, 2008.
  33. [Nosek et al., 2018] Brian A Nosek, Charles R Ebersole, Alexander C DeHaven, and David T Mellor. The prereg- istration revolution. Proceedings of the National Academy of Sciences, 115(11):2600-2606, 2018.
  34. [Nunes and Jannach, 2017] Ingrid Nunes and Dietmar Jan- nach. A systematic review and taxonomy of explanations in decision support and recommender systems. User Mod- eling and User-Adapted Interaction, 27:393-444, 2017.
  35. [Peer et al., 2014] Eyal Peer, Joachim Vosgerau, and Alessandro Acquisti. Reputation as a sufficient condition for data quality on amazon mechanical turk. Behavior research methods, 46:1023-1031, 2014.
  36. [Pugh, 2020] Jonathan Pugh. Autonomy, rationality, and contemporary bioethics. Oxford University Press, 2020.
  37. [Rao and Georgeff, 1995] Anand Rao and Michael Georgeff. BDI Agents: From Theory to Practice. Proceedings of the First International Conference on Multi-Agent Systems (ICMAS-95), 95:312-319, 1995.
  38. [Reich and Eyssel, 2013] Natalia Reich and Friederike Eyssel. Attitudes towards service robots in domestic environments: The role of personality characteristics, individual interests, and demographic variables. Paladyn, Journal of Behavioral Robotics, 4(2):123-130, 2013.
  39. [Ribera and Lapedriza, 2019] Mireia Ribera and Àgata Lapedriza. Can we do better explanations? a proposal of user-centered explainable ai. In IUI Workshops, 2019.
  40. [Robbemond et al., 2022] Vincent Robbemond, Oana Inel, and Ujwal Gadiraju. Understanding the Role of Expla- nation Modality in AI-assisted Decision-making. UMAP, pages 223-233, 2022.
  41. [Sanneman and Shah, 2022] Lindsay Sanneman and Julie A. Shah. The situation awareness framework for explainable ai (safe-ai) and human factors considerations for xai sys- tems. International Journal of Human-Computer Interac- tion, 38(18-20):1772-1788, 2022.
  42. [Song and Kim, 2022] Christina Soyoung Song and Youn- Kyung Kim. The role of the human-robot interaction in consumers' acceptance of humanoid retail service robots. Journal of Business Research, 146:489-503, 2022.
  43. [Such, 2017] Jose Such. Privacy and autonomous systems. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pages 4761-4767, 2017. IJCAI
  44. [van Nuenen et al., 2020] Tom van Nuenen, Xavier Ferrer, Jose Such, and Mark Cote. Transparency for whom? as- sessing discriminatory artificial intelligence. IEEE Com- puter, 53:36-44, 2020.
  45. [Varnum et al., 2010] Michael E.W. Varnum, Igor Gross- mann, Shinobu Kitayama, and Richard E. Nisbett. The origin of cultural differences in cognition: The social ori- entation hypothesis. Current Directions in Psychological Science, 19(1):9-13, 2010.
  46. [Venkatesh et al., 2003] Viswanath Venkatesh, Michael G. Morris, Gordon B. Davis, and Fred D. Davis. User accep- tance of information technology: Toward a unified view. MIS Quarterly, 27(3):425-478, 2003.
  47. [Wachowiak et al., 2023] Lennart Wachowiak, Oya Celiktu- tan, Andrew Coles, and Gerard Canal. A survey of evalua- tion methods and metrics for explanations in human-robot interaction (hri). In ICRA2023 Workshop on Explainable Robotics, 2023.
  48. [Wachowiak et al., 2024] Lennart Wachowiak, Andrew Fenn, Haris Kamran, Andrew Coles, Oya Celiktutan, and Gerard Canal. When do people want an explanation from a robot? In Proc. of the 2024 ACM/IEEE HRI, 2024.
  49. [Winikoff and Sidorenko, 2023] Michael Winikoff and Galina Sidorenko. Evaluating a mechanism for explaining bdi agent behaviour. In EXTRAAMAS@AAMAS, pages 18-37, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards