Proceedings

Detection and Analysis of Offensive Online Content in Hausa Language

Download BibTeX Cite

Proceedings of the Second IJCAI AI for Good Symposium in Africa hosted by Deep Learning Indaba. Indaba. Pages 2-14.

https://doi.org/10.24963/ijcai.aai4g.2024/1

Abstract

Hausa, a major Chadic language spoken by over 100 million people mostly in West Africa is considered a low-resource language from a computational linguistic perspective. This classification indicates a scarcity of linguistic resources and tools necessary for handling various natural language processing (NLP) tasks, including the detection of offensive content. To address this gap, we conducted two set of studies (1) a user study ($n=101$) to explore cyberbullying in Hausa and (2) an empirical study that led to the creation of the first dataset of offensive terms in the Hausa language. We developed detection systems trained on this dataset and compared their performance against relevant multilingual models, including Google Translate. Our detection system successfully identified over 70\% of offensive, whereas baseline models frequently mistranslated such terms. We attribute this discrepancy to the nuanced nature of the Hausa language and the reliance of baseline models on direct or literal translation due to limited data to build purposive detection systems. These findings highlight the importance of incorporating cultural context and linguistic nuances when developing NLP models for low-resource languages such as Hausa. A post hoc analysis further revealed that offensive language is particularly prevalent in discussions related to religion and politics. To foster a safer online environment, we recommend involving diverse stakeholders with expertise in local contexts and demographics. Their insights will be crucial in developing more accurate detection systems and targeted moderation strategies that align with cultural sensitivities.

  1. [Abubakar et al., 2021] Amina Imam Abubakar, Abubakar Roko, Aminu Muhammad Bui, and Ibrahim Saidu. An enhanced feature acquisition for sentiment analysis of en- glish and hausa tweets. International Journal of Advanced Computer Science and Applications, 12(9), 2021.
  2. [Al-Garadi et al., 2016] Mohammed Ali Al-Garadi, Kas- turi Dewi Varathan, and Sri Devi Ravana. Cybercrime de- tection in online communications: The experimental case of cyberbullying detection in the twitter network. Comput- ers in Human Behavior, 63:433-443, 2016.
  3. [Aliyu et al., 2023] Saminu Mohammad Aliyu, Idris Abdul- mumin, Shamsuddeen Hassan Muhammad, Ibrahim Said Ahmad, Saheed Abdullahi Salahudeen, Aliyu Yusuf, and Falalu Ibrahim Lawan. Hausanlp at semeval-2023 task 10: Transfer learning, synthetic data and side-information for multi-level sexism classification. arXiv preprint arXiv:2305.00076, 2023.
  4. [Altay and Alatas, 2018] Elif Varol Altay and Bilal Alatas. Detection of cyberbullying in social networks using ma- chine learning methods. In 2018 International Congress on Big Data, Deep Learning and Fighting Cyber Terror- ism (IBIGDELFT), pages 87-91. IEEE, 2018.
  5. [Amin et al., 2020] Mohammad Amin, Seyed Mahdi Naha- vandi, and Mohammad Ghasemi. Various strategies for detecting online abusive content and combating cyber- bullying. IEEE Access, 8:64595-64606, 2020.
  6. [Antypas et al., 2022] Dimosthenis Antypas, Asahi Ushio, Jose Camacho-Collados, Leonardo Neves, Vítor Silva, and Francesco Barbieri. Twitter topic classification. arXiv preprint arXiv:2209.09824, 2022.
  7. [Balakrishnan et al., 2023] Vimala Balakrishnan, Vithy- atheri Govindan, and Kumanan N Govaichelvan. Tamil offensive language detection: Supervised versus unsuper- vised learning approaches. ACM Transactions on Asian and Low-Resource Language Information Processing, 22(4):1-14, 2023.
  8. [Basile et al., 2019] Valerio Basile, Cristina Bosco, Elisa- betta Fersini, Debora Nozza, Viviana Patti, Francisco Manuel Rangel Pardo, Paolo Rosso, and Manuela San- guinetti. Semeval-2019 task 5: Multilingual detection of hate speech against immigrants and women in twitter. In Proceedings of the 13th international workshop on seman- tic evaluation, pages 54-63, 2019.
  9. [Bello et al., 2023] Bello Shehu Bello, Muham- mad Abubakar Alhassan, and Isa Inuwa-Dutse. # endsars protest: Discourse and mobilisation on twitter. arXiv preprint arXiv:2301.06176, 2023.
  10. [Bully Facts, 2023] Bully Facts. Bullying statistics. http://www.bullyingstatistics.org/category/bully-facts, 2023. Accessed: 13-09-2023. Link
  11. [Caselli et al., 2020a] Tommaso Caselli, Valerio Basile, Je- lena Mitrović, and Michael Granitzer. Hatebert: Retrain- ing bert for abusive language detection in english. arXiv preprint arXiv:2010.12472, 2020.
  12. [Caselli et al., 2020b] Tommaso Caselli, Valerio Basile, Je- lena Mitrović, Inga Kartoziya, and Michael Granitzer. I feel offended, don't be abusive! implicit/explicit messages in offensive and abusive language. In Proceedings of the 12th language resources and evaluation conference, pages 6193-6202, 2020.
  13. [Chaure et al., 2019] Ms Mrunali D Chaure, Jayant P Mehare, et al. Text classification and analysis with social media platform. IJRAR-International Journal of Research and Analytical Reviews (IJRAR), 6(4):276-280, 2019.
  14. [Conneau et al., 2019] Alexis Conneau, Kartikay Khandel- wal, Naman Goyal, Vishrav Chaudhary, Guillaume Wen- zek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. Unsupervised cross- lingual representation learning at scale. arXiv preprint arXiv:1911.02116, 2019.
  15. [Dambo et al., 2022] Tamar Haruna Dambo, Metin Ersoy, Ahmad Muhammad Auwal, Victor Oluwafemi Olorun- sola, and Mehmet Bahri Saydam. Office of the citizen: a qualitative analysis of twitter activity during the lekki shooting in nigeria's# endsars protests. Information, Com- munication & Society, 25(15):2246-2263, 2022.
  16. [Davidson et al., 2019] Thomas Davidson, Debasmita Bhat- tacharya, and Ingmar Weber. Racial bias in hate speech and abusive language detection datasets. arXiv preprint arXiv:1905.12516, 2019.
  17. [Devlin et al., 2019] Jacob Devlin, Ming-Wei Chang, Ken- ton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understand- ing. In Proceedings of the 2019 conference of the North American chapter of the association for computational lin- guistics: human language technologies, volume 1 (long and short papers), pages 4171-4186, 2019.
  18. [Dollarhide, 2021] M Dollarhide. Social media: Definition, effects, and list of top apps. Retrieved from Investopedia: https://www. investopedia. com/terms/s/social-media. asp, 2021. Link
  19. [ECRI Policy, 2023] ECRI Policy. Euro- pean commission against racism and in- tolerance. https://www.coe.int/en/web/ european-commission-against-racism-and-intolerance/ recommendation-no.15, 2023. Accessed: 10-09-2023. Link
  20. [EU Code, 2023] EU Code. Code of conduct on coun- tering illegal hate speech online. https://ec.europa.eu/ commission/presscorner/detail/en/qanda 20 1135, 2023. Accessed: 15-09-2023. Link
  21. [Founta et al., 2018] Antigoni Maria Founta, Constantinos Djouvas, Despoina Chatzakou, Ilias Leontiadis, Jeremy Blackburn, Gianluca Stringhini, Athena Vakali, Michael Sirivianos, and Nicolas Kourtellis. Large scale crowd- sourcing and characterization of twitter abusive behavior. In Twelfth International AAAI Conference on Web and So- cial Media, 2018.
  22. [Freelon et al., 2016] Deen Freelon, Charlton D McIlwain, and Meredith Clark. Beyond the hashtags:# ferguson,# blacklivesmatter, and the online struggle for offline justice. Center for Media & Social Impact, American University, Forthcoming, 2016.
  23. [Haffner, 2018] Matthew Haffner. A spatial analysis of non- english twitter activity in houston, tx. Transactions in GIS, 22(4):913-929, 2018.
  24. [Ibrahim et al., 2022] Umar Adam Ibrahim, Moussa Ma- hamat Boukar, and Muhammed Aliyu Suleiman. Devel- opment of hausa dataset a baseline for speech recognition. Data in Brief, 40:107820, 2022.
  25. [Inuwa-Dutse, 2021] Isa Inuwa-Dutse. The first large scale collection of diverse hausa language datasets. arXiv preprint arXiv:2102.06991, 2021.
  26. Ishaku et al., ] Joy Nanyisopwa Ishaku, Muhammad Mustapha, and Ubaidallah Muhammad Bello. Contrastive analysis of lexical and structural ambiguity between hausa and english languages.
  27. [Kebriaei et al., 2023] Emad Kebriaei, Ali Homayouni, Roghayeh Faraji, Armita Razavi, Azadeh Shakery, Hes- haam Faili, and Yadollah Yaghoobzadeh. Persian offen- sive language detection. Machine Learning, pages 1-21, 2023.
  28. [Kennedy, 2006] Helen Kennedy. Beyond anonymity, or fu- ture directions for internet identity research. New media & society, 8(6):859-876, 2006.
  29. [Khan et al., 2023] Anas Ali Khan, M Hammad Iqbal, Shibli Nisar, Awais Ahmad, and Waseem Iqbal. Offensive lan- guage detection for low resource language using deep se- quence model. IEEE Transactions on Computational So- cial Systems, 2023.
  30. [Kiela et al., 2020] Douwe Kiela, Hamed Firooz, Aravind Mohan, Vedanuj Goswami, Amanpreet Singh, Pratik Ringshia, and Davide Testuggine. The hateful memes challenge: Detecting hate speech in multimodal memes. Advances in neural information processing systems, 33:2611-2624, 2020.
  31. [Kovács et al., 2022] György Kovács, Pedro Alonso, Rajku- mar Saini, and Marcus Liwicki. Leveraging external re- sources for offensive content detection in social media. AI Communications, 35(2):87-109, 2022.
  32. [Kumar et al., 2014] Shamanth Kumar, Fred Morstatter, and Huan Liu. Twitter data analytics. Springer, 2014.
  33. [Kusumawardani and Basri, 2017] RP Kusumawardani and MH Basri. Topic identification and categorization of pub- lic information in community-based social media. In Jour- nal of Physics: Conference Series, volume 801, page 012075. IOP Publishing, 2017.
  34. [Machuve et al., 2022] Dina Machuve, Ciira Maina, and Wacuka Maina. Herdphobia: a dataset for hate speech against fulani in nigeria. 2022.
  35. [Magee et al., 2013] Rachel M Magee, Denise E Agosto, Andrea Forte, June Ahn, Michael Dickard, and Rebecca Reynolds. Teens and social media: Where are we now, where next? Proceedings of the American Society for In- formation Science and Technology, 50(1):1-4, 2013.
  36. [Markov et al., 2023] Todor Markov, Chong Zhang, Sand- hini Agarwal, Florentine Eloundou Nekoul, Theodore Lee, Steven Adler, Angela Jiang, and Lilian Weng. A holistic approach to undesired content detection in the real world. In Proceedings of the AAAI Conference on Artificial Intel- ligence, volume 37, pages 15009-15018, 2023.
  37. [Mathew et al., 2021] Binny Mathew, Punyajoy Saha, Seid Muhie Yimam, Chris Biemann, Pawan Goyal, and Animesh Mukherjee. Hatexplain: A benchmark dataset for explainable hate speech detection. In Proceedings of the AAAI conference on artificial intelligence, volume 35, pages 14867-14875, 2021.
  38. [Miao et al., 2023] Zhenxiong Miao, Xingshu Chen, Haizhou Wang, Rui Tang, Zhou Yang, Tiemai Huang, and Wenyi Tang. Detecting offensive language based on graph attention networks and fusion features. IEEE Transactions on Computational Social Systems, 2023.
  39. [Mikolov et al., 2013] Tomas Mikolov, Kai Chen, Greg Corrado, and Jeffrey Dean. Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781, 2013.
  40. [Miller, 2010] Harvey J Miller. The data avalanche is here. shouldn't we be digging? Journal of Regional Science, 50(1):181-201, 2010.
  41. [Muhammad et al., 2022] Shamsuddeen Hassan Muham- mad, David Ifeoluwa Adelani, Ibrahim Said Ahmad, Idris Abdulmumin, Bello Shehu Bello, Monojit Choudhury, Chris Chinenye Emezue, Anuoluwapo Aremu, Saheed Abdul, and Pavel Brazdil. Naijasenti: A nigerian twit- ter sentiment corpus for multilingual sentiment analysis. arXiv preprint arXiv:2201.08277, 2022.
  42. [Nemes and Kiss, 2021] László Nemes and Attila Kiss. In- formation extraction and named entity recognition sup- ported social media sentiment analysis during the covid-19 pandemic. Applied Sciences, 11(22):11017, 2021.
  43. [Nie et al., 2020] Yuyang Nie, Yuanhe Tian, Xiang Wan, Yan Song, and Bo Dai. Named entity recognition for social media texts with semantic augmentation. arXiv preprint arXiv:2010.15458, 2020.
  44. [Olteanu et al., 2015] Alexandra Olteanu, Ingmar Weber, and Daniel Gatica-Perez. Characterizing the demograph- ics behind the# blacklivesmatter movement. arXiv preprint arXiv:1512.05671, 2015.
  45. [Oriola and Kotzé, 2020] Oluwafemi Oriola and Eduan Kotzé. Evaluating machine learning techniques for de- tecting offensive and hate speech in south african tweets. IEEE Access, 8:21496-21509, 2020.
  46. [Oyewusi et al., 2021] Wuraola Fisayo Oyewusi, Olubayo Adekanmbi, Ifeoma Okoh, Vitus Onuigwe, Mary Idera Salami, Opeyemi Osakuade, Sharon Ibejih, and Us- man Abdullahi Musa. Naijaner: Comprehensive named entity recognition for 5 nigerian languages. arXiv preprint arXiv:2105.00810, 2021.
  47. [Plaza-Del-Arco et al., 2021] Flor Miriam Plaza-Del-Arco, M Dolores Molina-González, L Alfonso Ureña-López, and María Teresa Martín-Valdivia. A multi-task learn- ing approach to hate speech detection leveraging sentiment analysis. IEEE Access, 9:112478-112489, 2021.
  48. [Puspitasari, 2017] Septy Puspitasari. Arab spring: A case study of egyptian revolution 2011. Andalas Journal of In- ternational Studies (AJIS), 6(2):159-176, 2017.
  49. [Rafiq et al., 2018] Rahat Ibn Rafiq, Homa Hosseinmardi, Richard Han, Qin Lv, and Shivakant Mishra. Scalable and timely detection of cyberbullying in online social net- works. In Proceedings of the 33rd Annual ACM Sympo- sium on Applied Computing, pages 1738-1747, 2018.
  50. [Rajalakshmi et al., 2023] Ratnavel Rajalakshmi, Srivarshan Selvaraj, Pavitra Vasudevan, et al. Hottest: Hate and of- fensive content identification in tamil using transformers and enhanced stemming. Computer Speech & Language, 78:101464, 2023.
  51. [Rane and Salem, 2012] Halim Rane and Sumra Salem. So- cial media, social movements and the diffusion of ideas in the arab uprisings. Journal of international communica- tion, 18(1):97-111, 2012.
  52. [Saeed et al., 2023] Ramsha Saeed, Hammad Afzal, Sadaf Abdul Rauf, and Naima Iltaf. Detection of offensive language and its severity for low resource language. ACM Transactions on Asian and Low-Resource Language Information Processing, 22(6):1-27, 2023.
  53. [Sanguinetti et al., 2018] Manuela Sanguinetti, Fabio Po- letto, Cristina Bosco, Viviana Patti, and Marco Stranisci. An italian twitter corpus of hate speech against immi- grants. In Proceedings of the eleventh international con- ference on language resources and evaluation (LREC 2018), 2018.
  54. Sani et al., ] Muhammad Sani, Abubakar Ahmad, and Hadiza S Abdulazeez. Sentiment analysis of hausa lan- guage tweet using machine learning approach. [Schmidt and Wiegand, 2017]
  55. Anna Schmidt and Michael Wiegand. A survey on hate speech detection using natural language processing. In Proceedings of the fifth interna- tional workshop on natural language processing for social media, pages 1-10, 2017.
  56. [Simpson. and Weiner, 2019] John Simpson. and Edmund Weiner. Oxford of Dictionary. Oxford University Press, Oxford, UK, 2019.
  57. [Sinyangwe et al., 2023] Clement Sinyangwe, Douglas Kunda, and William Phiri Abwino. Detecting hate speech and offensive language using machine learning in pub- lished online content. Zambia ICT Journal, 7(1):79-84, 2023.
  58. [Suleiman et al., 2019] MA Suleiman, Muktar M Aliyu, and SI Zimit. Towards the development of hausa language cor- pus. Int. J. Sci. Eng. Res, 10:1598-1604, 2019.
  59. [Tsvetkov, 2017] Yulia Tsvetkov. Opportunities and chal- lenges in working with low-resource languages. Slides Part-1, 2017.
  60. [Van Hee et al., 2018] Cynthia Van Hee, Gilles Jacobs, Chris Emmery, Bart Desmet, Els Lefever, Ben Verhoeven, Guy De Pauw, Walter Daelemans, and Véronique Hoste. Auto- matic detection of cyberbullying in social media text. PloS one, 13(10):e0203794, 2018.
  61. [Warf, 2018] Barney Warf. The SAGE Encyclopedia of the Internet. Sage, 2018.
  62. [Yao et al., 2019] Mengfan Yao, Charalampos Chelmis, and Daphney-Stavroula Zois. Cyberbullying ends here: To- wards robust detection of cyberbullying in social media. In The World Wide Web Conference, pages 3427-3433, 2019.
  63. [Zandam et al., 2023] Abubakar Yakubu Zandam, Fa- tima Adam Muhammad, and Isa Inuwa-Dutse. Online threats detection in hausa language. In 4th Workshop on African Natural Language Processing, 2023.
  64. [Zhong et al., 2016] Haoti Zhong, Hao Li, Anna Cinzia Squicciarini, Sarah Michele Rajtmajer, Christopher Grif- fin, David J Miller, and Cornelia Caragea. Content-driven detection of cyberbullying on the instagram social net- work. In IJCAI, volume 16, pages 3952-3958, 2016. IJCAI
  65. [Zishumba, 2019] Kudzai Zishumba. Sentiment Analysis Based on Social Media Data. PhD thesis, 2019.
  66. [Zois et al., 2018] Daphney-Stavroula Zois, Angeliki Kapodistria, Mengfan Yao, and Charalampos Chelmis. Optimal online cyberbullying detection. In 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pages 2017-2021. IEEE, 2018.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards