Proceedings

Implicit Identity Technologies for LLMs: Fingerprinting and Watermarking Across Datasets, Models, and Generated Content

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Survey Track. Pages 7929-7939.

https://doi.org/10.24963/ijcai.2026/880

Abstract

Large language models (LLMs) require substantial investments and are increasingly deployed in high-stakes domains, making it critical to protect LLM-related assets and to trace their provenance. Identity technologies such as fingerprinting and watermarking address these needs by enabling ownership verification and attribution, and have rapidly emerged as an active research focus. However, existing techniques lack a systematic organisation, leading to two key issues, terminological confusion and isolated research lines, that have hindered the development of this research field. To this end, we present a comprehensive review of LLM identity techniques, focusing on fingerprinting and watermarking across the LLM lifecycle, including datasets, models, and generated content. We make three primary contributions. First, we introduce implicit identity (Implicit-ID for short) as a unifying abstraction and distinguish fingerprinting from watermarking. Second, we propose a lifecycle-based taxonomy that organises techniques by asset type and verification role, aligning each with asset protection or provenance.

Third, we establish an evaluation framework around three objectives---identifiability, robustness, and deployability. Together, these contributions structure the landscape of LLM identity techniques, clarify terminology, and highlight directions toward secure deployment.

  1. Wissam Antoun, Benoît Sagot, and Djamé Seddah. From text to source: Results in detecting large language model- generated content. In Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, and Nianwen Xue, editors, Proceedings of the 2024 Joint Inter- national Conference on Computational Linguistics, Lan- guage Resources and Evaluation (LREC-COLING 2024), pages 7531-7543, Torino, Italia, May 2024. ELRA and ICCL.
  2. Yehonatan Bitton, Elad Bitton, and Shai Nisan. Detect- ing stylistic fingerprints of large language models. arXiv preprint arXiv:2503.01659, 2025.
  3. Nicholas Carlini, Florian Tramer, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom Brown, Dawn Song, Ulfar Erlingsson, et al. Extracting training data from large language models. In 30th USENIX security symposium (USENIX Security 21), pages 2633-2650, 2021.
  4. Jialuo Chen, Jingyi Wang, Tinglan Peng, Youcheng Sun, Peng Cheng, Shouling Ji, Xingjun Ma, Bo Li, and Dawn Song. Copy, right? a testing framework for copyright pro- tection of deep learning models. In 2022 IEEE symposium on security and privacy (SP), pages 824-841. IEEE, 2022.
  5. Miranda Christ, Sam Gunn, and Or Zamir. Undetectable wa- termarks for language models. In The Thirty Seventh An- nual Conference on Learning Theory, pages 1125-1139.
  6. PMLR, 2024.
  7. Sumanth Dathathri, Abigail See, Sumedh Ghaisas, Po-Sen Huang, Rob McAdam, Johannes Welbl, Vandana Bachani, Alex Kaskasoli, Robert Stanforth, Tatiana Matejovicova, et al. Scalable watermarking for identifying large language model outputs. Nature, 634(8035):818-823, 2024.
  8. Linkang Du, Xuanru Zhou, Min Chen, Chusong Zhang, Zhou Su, Peng Cheng, Jiming Chen, and Zhikun Zhang. Sok: Dataset copyright auditing in machine learning systems. In 2025 IEEE Symposium on Security and Privacy (SP), pages 1-19. IEEE, 2025.
  9. Chenchen Gu, XIANG LI, Percy Liang, and Tatsunori Hashimoto. On the learnability of watermarks for language models. In B. Kim, Y. Yue, S. Chaudhuri, K. Fragkiadaki, M. Khan, and Y. Sun, editors, International Conference on Learning Representations, volume 2024, pages 38745- 38768, 2024.
  10. Martin Gubri, Dennis Ulmer, Hwaran Lee, Sangdoo Yun, and Seong Joon Oh. TRAP: Targeted random adversarial prompt honeypot for black-box identification. In Lun-Wei Ku, Andre Martins, and Vivek Srikumar, editors, Findings of the Association for Computational Linguistics: ACL 2024, pages 11496-11517, Bangkok, Thailand, August 2024. Association for Computational Linguistics.
  11. Xin He, Junxi Shen, Zhenheng Tang, Xiaowen Chu, Bo Li, Ivor W Tsang, and Yew-Soon Ong. Routemark: A finger- print for intellectual property attribution in routing-based model merging. arXiv preprint arXiv:2508.01784, 2025.
  12. Abe Hou, Jingyu Zhang, Tianxing He, Yichen Wang, Yung- Sung Chuang, Hongwei Wang, Lingfeng Shen, Benjamin Van Durme, Daniel Khashabi, and Yulia Tsvetkov. Sem- stamp: A semantic watermark with paraphrastic robustness for text generation. In Proceedings of the 2024 Confer- ence of the North American Chapter of the Association for Computational Linguistics: Human Language Technolo- gies (Volume 1: Long Papers), pages 4067-4082, 2024.
  13. Abe Hou, Jingyu Zhang, Yichen Wang, Daniel Khashabi, and Tianxing He. k-semstamp: A clustering-based seman- tic watermark for detection of machine-generated text. In Findings of the Association for Computational Linguistics: ACL 2024, pages 1706-1715, 2024.
  14. Linshan Hou, Zhongyun Hua, Wei Luo, and Leo Yu Zhang. Fixguard: Repairing backdoored models via class-wise trigger recovery and unlearning. IEEE Signal Processing Letters, 32:2544-2548, 2025.
  15. Zhengmian Hu, Lichang Chen, Xidong Wu, Yihan Wu, Hongyang Zhang, and Heng Huang. Unbiased watermark for large language models. In B. Kim, Y. Yue, S. Chaud- huri, K. Fragkiadaki, M. Khan, and Y. Sun, editors, Inter- national Conference on Learning Representations, volume 2024, pages 45408-45436, 2024.
  16. Zonghao Huang, Neil Zhenqiang Gong, and Michael K Re- iter. A general framework for data-use auditing of ml mod- els. In Proceedings of the 2024 on ACM SIGSAC Con- ference on Computer and Communications Security, pages 1300-1314, 2024.
  17. Dmitri Iourovitski, Sanat Sharma, and Rakshak Talwar. Hide and seek: Fingerprinting large language models with evolutionary learning. arXiv preprint arXiv:2408.02871, 2024.
  18. Heng Jin, Chaoyu Zhang, Shanghao Shi, Wenjing Lou, and Y Thomas Hou. Proflingo: A fingerprinting-based intel- lectual property protection scheme for large language mod- els. In 2024 IEEE Conference on Communications and Network Security (CNS), pages 1-9. IEEE, 2024.
  19. John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, and Tom Goldstein. A watermark for large language models. In International Conference on Machine Learning, pages 17061-17084. PMLR, 2023.
  20. Shuai Li, Kejiang Chen, Jun Jiang, Jie Zhang, Qiyi Yao, Kai Zeng, Weiming Zhang, and Nenghai Yu. Editmark: Wa- termarking large language models based on model editing. arXiv preprint arXiv:2510.16367, 2025.
  21. Yanming Li, Seifeddine Ghozzi, Cédric Eichler, Nicolas An- ciaux, Alexandra Bensamoun, and Lorena Gonzalez Man- zano. Data provenance auditing of fine-tuned large lan- guage models with a text-preserving technique. arXiv preprint arXiv:2510.09655, 2025.
  22. Yuqing Liang, Jiancheng Xiao, Wensheng Gan, and Philip S Yu. Watermarking techniques for large language models: A survey. Artificial Intelligence Review, 59(2):74, 2026.
  23. Zilong Lin, Jian Cui, Xiaojing Liao, and XiaoFeng Wang. Malla: Demystifying real-world large language model in- tegrated malicious services. In 33rd USENIX Security Sym- posium (USENIX Security 24), pages 4693-4710, 2024.
  24. Gaoyang Liu, Tianlong Xu, Xiaoqiang Ma, and Chen Wang. Your model trains on my data? protecting intellectual prop- erty of training data via membership fingerprint authenti- cation. IEEE Transactions on Information Forensics and Security, 17:1024-1037, 2022.
  25. Aiwei Liu, Leyi Pan, Yijian Lu, Jingjing Li, Xuming Hu, Xi Zhang, Lijie Wen, Irwin King, Hui Xiong, and Philip Yu. A survey of text watermarking in the era of large language models. ACM Computing Surveys, 57(2):1-36, 2024.
  26. Pratyush Maini, Mohammad Yaghini, and Nicolas Papernot. Dataset inference: Ownership resolution in machine learn- ing. In International Conference on Learning Representa- tions, 2021.
  27. Pratyush Maini, Hengrui Jia, Nicolas Papernot, and Adam Dziedzic. Llm dataset inference: Did you train on my dataset? Advances in Neural Information Processing Sys- tems, 37:124069-124092, 2024.
  28. Justus Mattern, Fatemehsadat Mireshghallah, Zhijing Jin, Bernhard Schölkopf, Mrinmaya Sachan, and Taylor Berg- Kirkpatrick. Membership inference attacks against lan- guage models via neighbourhood comparison. In Anna Rogers, Jordan Boyd-Graber, and Naoaki Okazaki, edi- tors, Findings of the Association for Computational Lin- guistics: ACL 2023, pages 11330-11343, Toronto, Canada, July 2023. Association for Computational Linguistics.
  29. Weichuan Mo, Kongyang Chen, and Yatie Xiao. Tibw: Task- independent backdoor watermarking with fine-tuning re- silience for pre-trained language models. Mathematics (2227-7390), 13(2), 2025.
  30. MZ Naser. Auditing the shadows: A review of methods to detect shared training data in large language models. ACM Computing Surveys, 58(7):1-34, 2025.
  31. Anshul Nasery, Jonathan Hayase, Creston Brooks, Peiyao Sheng, Himanshu Tyagi, Pramod Viswanath, and Sewoong Oh. Scalable fingerprinting of large language models. In D. Belgrave, C. Zhang, H. Lin, R. Pascanu, P. Koniusz, M. Ghassemi, and N. Chen, editors, Advances in Neural In- formation Processing Systems, volume 38, pages 125116- 125152.
  32. Curran Associates, Inc., 2025.
  33. Dario Pasquini, {Evgenios M.} Kornaropoulos, and Giuseppe Ateniese. Llmmap: Fingerprinting for large language models. In Proceedings of the 34th USENIX Security Symposium, Proceedings of the 34th USENIX Security Symposium, pages 299-318, 2025. Publisher Copyright: © 2025 by The USENIX Association All Rights Reserved.; 34th USENIX Security Symposium, USENIX Security 2025 ; Conference date: 13-08-2025 Through 15-08-2025.
  34. Zhenzhen Ren, Guobiao Li, Sheng Li, Zhenxing Qian, and Xinpeng Zhang. Cotsrf: Utilize chain of thought as stealthy and robust fingerprint of large language models. ArXiv, abs/2505.16785, 2025.
  35. Mark Russinovich, Yanan Cai, and Ahmed Salem. Hey, That's My Model! Introducing Chain & Hash, an LLM Fingerprinting Technique. In International Conference on Learning Representations, 2026.
  36. Payel Sadhukhan and Tanujit Chakraborty. Footprints of data in a classifier: Understanding the privacy risks and solu- tion strategies. Information Systems Frontiers, pages 1-27, 2025.
  37. Shuo Shao, Yiming Li, Yu He, Hongwei Yao, Wenyuan Yang, Dacheng Tao, and Zhan Qin. Sok: Large language model copyright auditing via fingerprinting. arXiv preprint arXiv:2508.19843, 2025.
  38. Shuo Shao, Yiming Li, Hongwei Yao, Yifei Chen, Yuchen Yang, and Zhan Qin. Reading between the lines: Towards reliable black-box llm fingerprinting via zeroth-order gra- dient estimation. arXiv preprint arXiv:2510.06605, 2025.
  39. Weijia Shi, Anirudh Ajith, Mengzhou Xia, Yangsibo Huang, Daogao Liu, Terra Blevins, Danqi Chen, and Luke Zettle- moyer. Detecting pretraining data from large language models. In B. Kim, Y. Yue, S. Chaudhuri, K. Fragkiadaki, M. Khan, and Y. Sun, editors, International Conference on Learning Representations, volume 2024, pages 51826- 51843, 2024.
  40. Mingjie Sun, Yida Yin, Zhiqiu Xu, J Zico Kolter, and Zhuang Liu. Idiosyncrasies in large language models. In Aarti Singh, Maryam Fazel, Daniel Hsu, Simon Lacoste-Julien, Felix Berkenkamp, Tegan Maharaj, Kiri Wagstaff, and Jerry Zhu, editors, Proceedings of the 42nd International Conference on Machine Learning, volume 267 of Proceed- ings of Machine Learning Research, pages 57854-57885. PMLR, 13-19 Jul 2025.
  41. Teppei Suzuki, Ryokan Ri, and Sho Takase. Natural fingerprints of large language models. arXiv preprint arXiv:2504.14871, 2025.
  42. Shida Wang, Chaohu Liu, Yubo Wang, and Linli Xu. Fpedit: Robust llm fingerprinting through localized knowledge editing. arXiv preprint arXiv:2508.02092, 2025.
  43. Xuhong Wang, Haoyu Jiang, Yi Yu, Jingru Yu, Yilun Lin, Ping Yi, Yingchun Wang, Yu Qiao, Li Li, and Fei-Yue Wang. Building intelligence identification system via large language model watermarking: a survey and beyond. Arti- ficial Intelligence Review, 58(8):249, 2025.
  44. Zehao Wu, Yanjie Zhao, and Haoyu Wang. Tensorguard: Gradient-based model fingerprinting for llm similarity de- tection and family classification. In 2025 40th IEEE/ACM International Conference on Automated Software Engi- neering (ASE), pages 445-456, 2025.
  45. Jiashu Xu, Fei Wang, Mingyu Ma, Pang Wei Koh, Chaowei Xiao, and Muhao Chen. Instructional fingerprinting of large language models. In Proceedings of the 2024 Confer- ence of the North American Chapter of the Association for Computational Linguistics: Human Language Technolo- gies (Volume 1: Long Papers), pages 3277-3306, 2024.
  46. Zhenhua Xu, Wenpeng Xing, Zhebo Wang, Chang Hu, Chen Jie, and Meng Han. Fp-vec: Fingerprinting large lan- guage models via efficient vector addition. arXiv preprint arXiv:2409.08846, 2024.
  47. Xiaojun Xu, Yuanshun Yao, and Yang Liu. Learning to Wa- termark LLM-Generated Text via Reinforcement Learning. In ICLR 2025 Workshops: WMARK, 2025.
  48. Yijie Xu, Aiwei Liu, Xuming Hu, Lijie Wen, and Hui Xiong. Mark your llm: Detecting the misuse of open-source large language models via watermarking. arXiv preprint arXiv:2503.04636, 2025.
  49. Zhenhua Xu, Zhebo Wang, Maike Li, Wenpeng Xing, Chun- qiang Hu, Chen Zhi, and Meng Han. Rap-sm: Ro- bust adversarial prompt via shadow models for copyright verification of large language models. arXiv preprint arXiv:2505.06304, 2025.
  50. Zhenhua Xu, Xubin Yue, Zhebo Wang, Qichen Liu, Xixiang Zhao, Jingxuan Zhang, Wenjun Zeng, Wengpeng Xing, Dezhang Kong, Changting Lin, et al. Copyright protec- tion for large language models: A survey of methods, challenges, and trends. arXiv preprint arXiv:2508.11548, 2025.
  51. Yuliang Yan, Haochun Tang, Shuo Yan, and Enyan Dai. Duf- fin: A dual-level fingerprinting framework for llms ip pro- tection. ArXiv, abs/2505.16530, 2025.
  52. Zhiguang Yang, Gejian Zhao, and Hanzhou Wu. Watermark- ing for large language models: A survey. Mathematics, 13(9):1420, 2025.
  53. Peigen Ye, Huali Ren, Zhengdao Li, Anli Yan, Hongyang Yan, Shaowei Wang, and Jin Li. Securing large language models: A survey of watermarking and fingerprinting tech- niques. ACM Computing Surveys, 2025.
  54. Do-hyeon Yoon, Minsoo Chun, Thomas Allen, Hans Müller, Min Wang, and Rajesh Sharma. Intrinsic fingerprint of llms: Continue training is not all you need to steal a model! arXiv preprint arXiv:2507.03014, 2025.
  55. Boyi Zeng, Lizheng Wang, Yuncong Hu, Yi Xu, Chenghu Zhou, Xinbing Wang, Yu Yu, and Zhouhan Lin. Huref: Human-readable fingerprint for large language models. Advances in Neural Information Processing Systems, 37:126332-126362, 2024.
  56. Boyi Zeng, Lin Chen, Ziwei He, Xinbing Wang, and Zhouhan Lin. Awm: Accurate weight-matrix fingerprint for large language models. arXiv preprint arXiv:2510.06738, 2025.
  57. Jie Zhang, Jiayuan Li, Haiqiang Fei, Lun Li, and Hongsong Zhu. Easydetector: Using linear probe to detect the prove- nance of large language models. In 2024 IEEE 23rd In- ternational Conference on Trust, Security and Privacy in Computing and Communications (TrustCom), pages 2410- 2417. IEEE, 2024.
  58. Jie Zhang, Dongrui Liu, Chen Qian, Linfeng Zhang, Yong Liu, Yu Qiao, and Jing Shao. Reef: Representation en- coding fingerprints for large language models. In Y. Yue, A. Garg, N. Peng, F. Sha, and R. Yu, editors, International Conference on Learning Representations, volume 2025, pages 48092-48117, 2025.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards