Proceedings

Shaping Shared Languages: Human and Large Language Models' Inductive Biases in Emergent Communication

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. Human-Centred AI. Pages 10298-10306.

https://doi.org/10.24963/ijcai.2025/1144

Abstract

Languages are shaped by the inductive biases of their users. Using a classical referential game, we investigate how artificial languages evolve when optimised for inductive biases in humans and large language models (LLMs) via Human-Human, LLM-LLM and Human-LLM experiments. We show that referentially grounded vocabularies emerge that enable reliable communication in all conditions, even when humans and LLMs collaborate. Comparisons between conditions reveal that languages optimised for LLMs subtly differ from those optimised for humans. Interestingly, interactions between humans and LLMs alleviate these differences and result in vocabularies more human-like than LLM-like. These findings advance our understanding of the role inductive biases in LLMs play in the dynamic nature of human language and contribute to maintaining alignment in human and machine communication. In particular, our work underscores the need to think of new LLM training methods that include human interaction and shows that using communicative success as a reward signal can be a fruitful, novel direction.

  1. [Beuls and Van Eecke, 2024] Katrien Beuls and Paul Van Eecke. Humans learn language from situated communicative interactions. what about machines? Computational Linguistics, 50(3):1277-1311, 2024.
  2. [Brighton and Kirby, 2006] Henry Brighton and Simon Kirby. Understanding linguistic evolution by visualizing the emergence of topographic mappings. Artificial Life, 12(2):229-242, 2006.
  3. [Brinkmann et al., 2023] Levin Brinkmann, Fabian Bau- mann, . . . , Thomas L, Joseph Henrich, et al. Machine culture. Nat. Hum. Behav., 7(11):1855-1868, 2023.
  4. [Chen et al., 2024] Angelica Chen, Ravid Shwartz-Ziv, Kyunghyun Cho, Matthew L Leavitt, and Naomi Saphra. Sudden drops in the loss: Syntax acquisition, phase transitions, and simplicity bias in MLMs. In ICLR, 2024.
  5. [Christiansen and Chater, 2008] Morten H. Christiansen and Nick Chater. Language as shaped by the brain. Behav. Brain Sci, 31(5):489-509, 2008.
  6. [Clark and Brennan, 1991] H. Clark and S. Brennan. Grounding in Communication, volume 13, pages 127- 149. 01 1991.
  7. [Conklin and Smith, 2023] Henry Conklin and Kenny Smith. Compositionality with variation reliably emerges in neural networks. In ICLR, 2023.
  8. [de Boer, 2006] Bart de Boer. Computer modelling as a tool for understanding language evolution. In Evo Epistemol- ogy, Language and Culture: A Non-Adaptationist, Systems Theoretical Approach, pages 381-406. 2006.
  9. [DeCaro et al., 2008] Marci S DeCaro, Robin D Thomas, and Sian L Beilock. Individual differences in category learning: Sometimes less working memory capacity is bet- ter than more. Cognition, 107(1):284-294, 2008.
  10. [Futrell and Mahowald, 2025] Richard Futrell and Kyle Ma- howald. How linguistics learned to stop worrying and love the language models, 2025. arXiv:2501.17047.
  11. [Galke and Raviv, 2025] Lukas Galke and Limor Raviv. Learning and communication pressures in neural net- works: Lessons from emergent communication. Language Development Research, 5(1):116-143, 2025.
  12. [Galke et al., 2024] Lukas Galke, Yoav Ram, and Limor Ra- viv. Deep neural networks and humans both benefit from compositional language structure. Nat. Commun, 15(1):10816, 2024.
  13. [Gibson et al., 2019] Edward Gibson, Richard Futrell, Steven P. Piantadosi, Isabelle Dautriche, Kyle Mahowald, Leon Bergen, and Roger Levy. How efficiency shapes human language. Trends Cogn Sci, 23(5):389-407, 2019.
  14. [Griffiths and Kalish, 2007] Thomas L. Griffiths and Michael L. Kalish. Language evolution by iterated learning with bayesian agents. Cogn. Sci., 31(3):441-480, 2007.
  15. [Griffiths et al., 2024] Thomas L. Griffiths, Jian-Qiao Zhu, Erin Grant, and R. Thomas McCoy. Bayes in the age of intelligent machines. Curr. Dir. Psychol, 33(5):283-291, 2024.
  16. [Hendrycks et al., 2021] Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt. Measuring massive multitask lan- guage understanding. In ICLR, 2021.
  17. [Hockett, 1960] Charles F. Hockett. The origin of speech. Scientific American, 203(3):88-97, 1960.
  18. [Josserand et al., 2024] Mathilde Josserand, Franc ¸ois Pel- legrino, Oxana Grosseck, Dan Dediu, and Limor Ra- viv. Adapting to individual differences: An experimental study of language evolution in heterogeneous populations. Cogn. Sci., 48(11), 2024.
  19. [Kallini et al., 2024] Julie Kallini, Isabel Papadimitriou, Richard Futrell, Kyle Mahowald, and Christopher Potts. Mission: Impossible language models. In Proc. of the 62nd Annual Meeting of ACL, pages 14691-14714, 2024.
  20. [Khatun and Brown, 2024] Aisha Khatun and Daniel G Brown. A study on large language models' limitations in multiple-choice question answering, 2024.
  21. [Kirby et al., 2008] Simon Kirby, Hannah Cornish, and Kenny Smith. Cumulative cultural evolution in the labora- tory: An experimental approach to the origins of structure in human language. PNAS, 105(31):10681-10686, 2008.
  22. [Kirby et al., 2014] Simon Kirby, Tom Griffiths, and Kenny Smith. Iterated learning and the evolution of language. CRNEUR, 28:108-114, 2014.
  23. [Kirby et al., 2015] Simon Kirby, Monica Tamariz, Hannah Cornish, and Kenny Smith. Compression and communica- tion in the cultural evolution of linguistic structure. Cog- nition, 141:87-102, 8 2015.
  24. [Kouwenhoven et al., 2022] Tom Kouwenhoven, Tessa Ver- hoef, Roy De Kleijn, and Stephan Raaijmakers. Emerg- ing grounded shared vocabularies between human and ma- chine, inspired by human language evolution. Frontiers in Artificial Intelligence, 5:886349, 2022.
  25. [Kouwenhoven et al., 2024] Tom Kouwenhoven, Max Peep- erkorn, Bram Van Dijk, and Tessa Verhoef. The curi- ous case of representational alignment: Unravelling visio- linguistic tasks in emergent communication. In CMCL, pages 57-71, 2024.
  26. [Kouwenhoven et al., 2025] Tom Kouwenhoven, Max Peep- erkorn, and Tessa Verhoef. Searching for structure: In- vestigating emergent communication with large language models. In COLING, pages 9977-9991, 2025.
  27. [Kozachkov et al., 2023] Leo Kozachkov, Ksenia V. Kasta- nenka, and Dmitry Krotov. Building transformers from neurons and astrocytes. PNAS, 120(34), 2023.
  28. [Lazaridou and Baroni, 2020] Angeliki Lazaridou and Marco Baroni. Emergent multi-agent communication in the deep learning era, 2020. arXiv:2006.02419.
  29. [Lee et al., 2024] Harrison Lee, Samrat Phatale, . . . , Abhi- nav Rastogi, and Sushant Prakash. Rlaif vs. rlhf: scaling reinforcement learning from human feedback with ai feed- back. In Proc. of the 41st ICML, ICML'24, 2024.
  30. [Li et al., 2016] Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. A diversity-promoting ob- jective function for neural conversation models. In Proc. of the 2016 Conference of NAACL, pages 110-119, 2016.
  31. [Liu et al., 2024] Nelson F. Liu, Kevin Lin, John Hewitt, Ashwin Paranjape, Michele Bevilacqua, Fabio Petroni, and Percy Liang. Lost in the middle: How language mod- els use long contexts. Trans. of ACL, 12:157-173, 2024.
  32. [Llama Team, 2024] Meta Llama Team. The llama 3 herd of models, 2024. arXiv:2407.21783.
  33. [Mikolov et al., 2018] Tomas Mikolov, Armand Joulin, and Marco Baroni. A roadmap towards machine intelligence. In CICLing, pages 29-61, Cham, 2018.
  34. [Millière and Rathkopf, 2024] Raphaël Millière and Charles Rathkopf. Anthropocentric bias and the possibility of arti- ficial cognition. In ICML Workshop, 2024.
  35. [Millière, 2024] Raphaël Millière. Language models as models of language, 2024. arXiv:2408.07144.
  36. [Mina et al., 2025] Mario Mina, Valle Ruiz-Fernández, Júlia Falcão, Luis Vasquez-Reina, and Aitor Gonzalez-Agirre. Cognitive biases, task complexity, and result intepretabil- ity in large language models. In COLING, pages 1767- 1784, 2025.
  37. [Nakagawa and Schielzeth, 2013] Shinichi Nakagawa and Holger Schielzeth. A general and simple method for ob- taining r2 from generalized linear mixed-effects models. Methods in Ecology and Evolution, 4(2):133-142, 2013.
  38. [Poletiek et al., 2018] Fenna H. Poletiek, Christopher M. Conway, Michelle R. Ellefson, Jun Lai, Bruno R. Bo- canegra, and Morten H. Christiansen. Under what condi- tions can recursion be learned? effects of starting small in artificial grammar learning of center-embedded structure. Cogn. Sci., 42(8):2855-2889, 2018.
  39. [Raviv et al., 2019] Limor Raviv, Antje Meyer, and Shiri Lev-Ari. Compositional structure can emerge without gen- erational transmission. Cognition, 182:151-164, 2019.
  40. [Raviv et al., 2021] Limor Raviv, Marianne de Heer Kloots, and Antje Meyer. What makes a language easy to learn? a preregistered study on how systematic structure and community size affect language learnability. Cognition, 210:104620, 2021.
  41. [Ren et al., 2024] Yi Ren, Shangmin Guo, Linlu Qiu, Bailin Wang, and Danica J. Sutherland. Bias amplification in lan- guage model evolution: An iterated learning perspective. In NeurIPS, volume 37, pages 38629-38664, 2024.
  42. [Rende et al., 2024] Riccardo Rende, Federica Gerace, Alessandro Laio, and Sebastian Goldt. A distributional simplicity bias in the learning dynamics of transformers. In NeurIPS, volume 37, pages 96207-96228, 2024.
  43. [Saito et al., 2023] Keita Saito, Akifumi Wachi, Koki Wataoka, and Youhei Akimoto. Verbosity bias in prefer- ence labeling by large language models. In NeurIPS 2023 Workshop on Inst. Tuning and Instr. Following, 2023. [Shumailov et al., 2024]
  44. Ilia Shumailov, Zakhar Shumaylov, Yiren Zhao, Nicolas Papernot, Ross Anderson, and Yarin Gal. AI models collapse when trained on recursively gen- erated data. Nature, 631(8022):755-759, 2024.
  45. [Smith and Culbertson, 2020] Kenny Smith and Jennifer Culbertson. Communicative pressures shape language during communication (not learning): Evidence from casemarking in artificial languages, 2020.
  46. [Smith et al., 2024] Kenny Smith, Simon Kirby, Shangmin Guo, and Thomas L Griffiths. Ai model collapse might be prevented by studying human language transmission. Nature, 633(8030):525, 2024.
  47. [Smith, 2022] Kenny Smith. How Language Learning and Language Use Create Linguistic Structure. Curr. Dir. Psy- chol. Sci., 31(2):177-186, 4 2022.
  48. [Steels et al., 2012] Luc Steels, Martin Loetzsch, et al. The grounded naming game. Experiments in cultural language evolution, 3:41-59, 2012.
  49. [Stöpler et al., 2025] Lennart Stöpler, Rufat Asadli, Mitja Nikolaus, Ryan Cotterell, and Alex Warstadt. Towards de- velopmentally plausible rewards: Communicative success as a learning signal for interactive language models, 2025.
  50. [Tamariz and Kirby, 2015] Mónica Tamariz and Simon Kirby. Culture: Copying, compression, and conventional- ity. Cogn. Sci., 39(1):171-183, 2015.
  51. [van Dijk et al., 2023] Bram van Dijk, Tom Kouwenhoven, Marco Spruit, and Max Johannes van Duijn. Large lan- guage models: The need for nuance in current debates and a pragmatic perspective on understanding. In Proc. of the 2023 Conference on EMNLP, pages 12641-12654, 2023.
  52. [Verhoef et al., 2024] Tessa Verhoef, Kiana Shahrasbi, and Tom Kouwenhoven. What does kiki look like? cross- modal associations between speech sounds and visual shapes in vision-and-language models. In CMCL, pages 199-213, 2024.
  53. [Wang et al., 2024] Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, and Barbara Plank. "my answer is C": First-token probabilities do not match text answers in instruction- tuned language models. In Findings of ACL 2024, pages 7407-7416, 2024.
  54. [Warstadt and Bowman, 2022] Alex Warstadt and Samuel R Bowman. What artificial neural networks can tell us about human language acquisition. In Algebraic structures in natural language, pages 17-60. 2022.
  55. [Wilcox et al., 2023] Ethan Gotlieb Wilcox, Richard Futrell, and Roger Levy. Using Computational Models to Test Syntactic Learnability. Ling. Inquiry, pages 1-44, 2023.
  56. [Zheng et al., 2023] Lianmin Zheng, Wei-Lin Chiang, . . . , Joseph E Gonzalez, and Ion Stoica. Judging llm-as-a- judge with mt-bench and chatbot arena. In NeurIPS, vol- ume 36, pages 46595-46623, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards