Proceedings

What is Behind Homelessness Bias? Using LLMs and NLP to Mitigate Homelessness by Acting on Social Stigma

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. AI and Social Good. Pages 9754-9762.

https://doi.org/10.24963/ijcai.2025/1084

Abstract

Bias towards people experiencing homelessness (PEH) is prevalent in online spaces. This project will leverage natural language processing (NLP) and large language models (LLMs) to identify, classify, and measure bias using geolocalized data collected from X (formerly Twitter), Reddit, meeting minutes, and news media across the United States. While public opinion often refers to addictions, criminality, and high levels of welfare spending to justify bias against PEH, we will conduct a comparative study to determine whether racial fractionalization is associated with homelessness bias. The results of the study aim to provide a new path to alleviate homelessness by unveiling the intersectional bias that affects PEH and minority racial groups. During the course of the project, we will deliver a lexicon, compile an annotated database for homelessness and homelessness-racism intersectional (HRI) bias, evaluate LLMs as classifiers of homelessness and HRI bias, develop homelessness and HRI bias metrics, and audit existing LLMs on HRI. In collaboration with non-profits and the city council of South Bend, Indiana, USA, our ultimate goal is to contribute to homelessness alleviation by counteracting social stigma, restoring the dignity and well-being of the persons affected.

  1. [Achiam et al., 2023] Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Alt- man, Shyamal Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774, 2023.
  2. [Alesina and Glaeser, 2013] Alberto Alesina and Edward L Glaeser. Fighting Poverty in the US and Europe. Oxford University Press, Oxford, 2013.
  3. [Allport, 1954] Gordon W Allport. The nature of prejudice. Basic Books, 1954.
  4. [Applebaum, 2001] Lauren D Applebaum. The influence of perceived deservingness on policy decisions regarding aid to the poor. Political psychology, 22(3):419-442, 2001.
  5. [Bhutani et al., 2024] Mukul Bhutani, Kevin Robinson, Vin- odkumar Prabhakaran, Shachi Dave, and Sunipa Dev. Seegull multilingual: a dataset of geo-culturally situated stereotypes. arXiv preprint arXiv:2403.05696, 2024.
  6. [Bouma, 2009] Gerlof Bouma. Normalized (pointwise) mu- tual information in collocation extraction. Proceedings of GSCL, 30:31-40, 2009.
  7. [Bouzoubaa et al., 2024] Layla Bouzoubaa, Elham Aghakhani, and Rezvaneh Rezapour. Words matter: Reducing stigma in online conversations about sub- stance use with large language models. arXiv preprint arXiv:2408.07873, 2024.
  8. [Byrne et al., 2013] Thomas Byrne, Ellen A Munley, Jami- son D Fargo, Ann E Montgomery, and Dennis P Cul- hane. New perspectives on community-level determinants of homelessness. Journal of Urban Affairs, 35(5):607- 625, 2013.
  9. [Caritas Spain, 2021] Caritas Spain. Relatorías Especiales de Naciones Unidas sobre la Extrema Pobreza y los Dere- chos Humanos y sobre el Derecho a una Vivienda Ade- cuada. Technical report, 2021.
  10. [Caselli et al., 2020] Tommaso Caselli, Valerio Basile, Je- lena Mitrović, and Michael Granitzer. Hatebert: Retrain- ing bert for abusive language detection in english. arXiv preprint arXiv:2010.12472, 2020.
  11. [Cho et al., 2023] Hyundong Cho, Shuai Liu, Taiwei Shi, Darpan Jain, Basem Rizk, Yuyang Huang, Zixun Lu, Nuan Wen, Jonathan Gratch, Emilio Ferrara, et al. Can language model moderators improve the health of online discourse? arXiv preprint arXiv:2311.10781, 2023.
  12. [Comim et al., 2020] Flavio Comim, Miháli Tamás Borsi, and Octasiano Valerio Medoza. The Multi-dimensions of Aporophobia. 2020.
  13. [Cortina, 2022] Adela Cortina. Aporophobia. Why we reject the poor instead of helping them. Princeton University Press, Princeton, 2022.
  14. [Cortiz and Zubiaga, 2020] Diogo Cortiz and Arkaitz Zubi- aga. Ethical and technical challenges of ai in tackling hate speech. The International Review of Information Ethics, 29, 2020.
  15. [Curto et al., 2024] Georgina Curto, Svetlana Kiritchenko, Kathleen C Fraser, and Isar Nejadgholi. The crime of be- ing poor: Associations between crime and poverty on so- cial media in eight countries. In Proceedings of the Sixth Workshop on Natural Language Processing and Compu- tational Social Science (NLP+ CSS 2024), pages 32-45, 2024.
  16. [de Sousa and Henry, 2024] Tanya de Sousa and Meghan Henry. The 2024 annual homelessness assessment report (ahar) to congress. Technical report, The U.S. Department of HUD, 2024.
  17. [Dellacca, 2024] Aynslee Dellacca. 'this is a human rights issue': South bend community discusses homeless shelter placement, 2024. Accessed: 2025-01-20.
  18. [Dieng et al., 2020] Adji B Dieng, Francisco JR Ruiz, and David M Blei. Topic modeling in embedding spaces. TACL, 8:439-453, 2020.
  19. [European Union, 2024] European Union. Regulation (EU) 2024/1689 of the European Parliament and of the Council of 13 June 2024 laying down harmonised rules on artificial intelligence and amending Regulations (Artificial Intelli- gence Act) (Text with EEA relevance), 2024.
  20. [Gallegos et al., 2024] Isabel O Gallegos, Ryan A Rossi, Joe Barrow, Md Mehrab Tanjim, Sungchul Kim, Franck Der- noncourt, Tong Yu, Ruiyi Zhang, and Nesreen K Ahmed. Bias and fairness in large language models: A survey. Computational Linguistics, pages 1-79, 2024.
  21. [Hovy and Spruit, 2016] Dirk Hovy and Shannon L Spruit. The social impact of natural language processing. In Pro- ceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 591-598, 2016.
  22. [Hu and Zhou, 2024] Taojun Hu and Xiao-Hua Zhou. Un- veiling llm evaluation focused on metrics: Challenges and solutions. arXiv preprint arXiv:2404.09135, 2024.
  23. [International Telecommunication Union, 2024] International Telecommunication Union. Internet use continues to grow, but universality remains elusive, especially in low-income regions, 2024. Accessed: 2025-01-31.
  24. [John Busby and Cooper, 2021] Julia Tanberk John Busby and Tyler Cooper. Broadbandnow estimates availability for all 50 states; confirms that more than 42 million amer- icans do not have access to broadband, 2021. Accessed: 2025-01-31.
  25. [Kiritchenko et al., 2023] Svetlana Kiritchenko, Georgina Curto Rex, Isar Nejadgholi, and Kathleen C Fraser. Aporophobia: An overlooked type of toxic language targeting the poor. In The 7th Workshop on Online Abuse and Harms (WOAH), pages 113-125, 2023.
  26. [Kothari, 2005] Miloon Kothari. Report of the special rap- porteur on adequate housing as a component of the right to an adequate standard of living. Technical report, UN Eco- nomic and Social Council Commision on Human Rights, 2005.
  27. [Lalor et al., 2022] John P Lalor, Yi Yang, Kendall Smith, Nicole Forsgren, and Ahmed Abbasi. Benchmarking in- tersectional biases in nlp. In Proceedings of the 2022 con- ference of the North American chapter of the association for computational linguistics: Human language technolo- gies, pages 3598-3609, 2022.
  28. [Leidinger and Rogers, 2024] Alina Leidinger and Richard Rogers. How are llms mitigating stereotyping harms? learning from search engine studies. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society, vol- ume 7, pages 839-854, 2024.
  29. [Liang et al., 2022] Percy Liang, Rishi Bommasani, Tony Lee, Dimitris Tsipras, Dilara Soylu, Michihiro Yasunaga, Yian Zhang, Deepak Narayanan, Yuhuai Wu, Ananya Ku- mar, et al. Holistic evaluation of language models. arXiv preprint arXiv:2211.09110, 2022.
  30. [Likas et al., 2003] Aristidis Likas, Nikos Vlassis, and Jakob J Verbeek. The global k-means clustering algorithm. Pattern recognition, 36(2):451-461, 2003.
  31. [Marshall et al., 2024] Carrie Anne Marshall, Rebecca Gewurtz, Caitlin Ross, Alyssa Becker, Abrial, Lau- rence Roy Cooke, Rosemary Lysaght Skye Barbic, and Bonnie Kirsh. Beyond Securing a tenancy: using the capabilities approach to identify the daily living needs of individuals during and following homelessness. Journal of Social Distress and Homelessness, VOL. 33, N, 2024.
  32. [Mei et al., 2023] Katelyn Mei, Sonia Fereidooni, and Aylin Caliskan. Bias against 93 stigmatized groups in masked language models and downstream sentiment classification tasks. In Proc. of the 2023 ACM FAccT, pages 1699-1710, 2023.
  33. [Mikolov et al., 2013] Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. Distributed rep- resentations of words and phrases and their composition- ality. Advances in neural information processing systems, 26, 2013.
  34. [Narayan and Petesch, 2002] Deepa Narayan and Patti Pe- tesch, editors. Voices of the Poor. From Many Lands. Oxford University Press & The World Bank, Washington, DC, 2002.
  35. [NIST, 2024] NIST. Artificial intelligence risk management framework: Generative artificial intelligence profile. Tech- nical Report NIST AI 600-1, U.S. Department of Com- merce, 2024. Accessed: 2025-02-10.
  36. [Parveen and Pandey, 2016] Huma Parveen and Shikha Pandey. Sentiment analysis on twitter data-set using naive bayes algorithm. In 2016 2nd iCATccT, pages 416-419. IEEE, 2016.
  37. [Raj et al., 2024] Chahat Raj, Anjishnu Mukherjee, Aylin Caliskan, Antonios Anastasopoulos, and Ziwei Zhu. Breaking bias, building bridges: Evaluation and mitiga- tion of social biases in llms via contact hypothesis. In Pro- ceedings of the AAAI/ACM Conference on AI, Ethics, and Society, volume 7, pages 1180-1189, 2024.
  38. [Ranjit et al., 2024] Jaspreet Ranjit, Brihi Joshi, Rebecca Dorn, Laura Petry, Olga Koumoundouros, Jayne Bottarini, Peichen Liu, Eric Rice, and Swabha Swayamdipta. Oath- frames: Characterizing online attitudes towards homeless- ness with llm assistants. arXiv preprint arXiv:2406.14883, 2024.
  39. [Rex et al., 2025] Georgina Curto Rex, Svetlana Kir- itchenko, Muhammad Hammad Fahim Siddiqui, Isar Nejadgholi, and Kathleen C Fraser. Tackling poverty by acting on social bias against the poor: a taxonomy and dataset on aporophobia. Forthcoming at the Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics, 2025.
  40. [Sen, 2001] Amartya Sen. Development as freedom. Oxford University Press, 2001.
  41. [Sheng et al., 2019] Emily Sheng, Kai-Wei Chang, Premku- mar Natarajan, and Nanyun Peng. The woman worked as a babysitter: On biases in language generation. arXiv preprint arXiv:1909.01326, 2019.
  42. [Srinivasan et al., 2019] Kumar Bhargav Srinivasan, Cristian Danescu-Niculescu-Mizil, Lillian Lee, and Chenhao Tan. Content removal as a moderation strategy: Compliance and other outcomes in the changemyview community. Proc. of the ACM on HCI, 3(CSCW):1-21, 2019.
  43. [Tan et al., 2021] Jimin Tan, Jianan Yang, Sai Wu, Gang Chen, and Jake Zhao. A critical look at the cur- rent train/test split in machine learning. arXiv preprint arXiv:2106.04525, 2021.
  44. Department of HUD. 2007-2024 point-in-time estimates by coc, 2024. Accessed: 2025-02-10.
  45. [U.S. Census Bureau, 2024] U.S. Census Bureau. American community survey 5-year data (2009-2023), 2024.
  46. U.S. Department of Commerce, Economics and Statistics Ad- ministration.
  47. [Vasiliev, 2020] Yuli Vasiliev. Natural language processing with Python and spaCy: A practical introduction. No Starch Press, 2020.
  48. [Vidgen et al., 2019] Bertie Vidgen, Helen Margetts, and Alex Harris. How much online abuse is there. Alan Turing Institute, 11, 2019.
  49. [Wang et al., 2024] Angelina Wang, Jamie Morgenstern, and John P Dickerson. Large language models should not re- place human participants because they can misportray and flatten identity groups. ArXiv preprint, abs/2402.01908, 2024.
  50. [World Population Review, 2024] World Population Review. Homelessness by country 2024, 2024. Accessed: 2025- 01-29.
  51. [Yacouby and Axman, 2020] Reda Yacouby and Dustin Ax- man. Probabilistic extension of precision, recall, and f1 score for more thorough evaluation of classification mod- els. In Proceedings of the first workshop on evaluation and comparison of NLP systems, pages 79-91, 2020.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards