Proceedings

Toward LoRA Copyright Protection with an Authorized Dual-Watermarking Framework

Download BibTeX Cite

Proceedings of the Thirty-Fifth International Joint Conference on Artificial Intelligence. Main Track. Pages 853-861.

https://doi.org/10.24963/ijcai.2026/96

Abstract

Text-to-Image (T2I) diffusion models have been widely adopted due to their strong generative capabilities, while Low-Rank Adaptation (LoRA) has emerged as an efficient mechanism for customizing these models for diverse creative and commercial applications. This trend has fostered LoRA-centric service platforms that that enable the customization and commercial distribution of LoRA modules according to user requirements. However, the growing prevalence of LoRA and its critical role in customized AI services have raised urgent concerns about LoRA copyright protection. To address this gap, we propose LoRA2D, an authorized dual-watermarking framework specifically designed to protect LoRA modules in T2I diffusion models. LoRA2D integrates license-based authorization control with explicit watermarks as visible deterrents for unauthorized or trial usage, which can be removed upon valid authorization, while persistently embedding an implicit watermark for robust black-box ownership verification. Extensive experiments on multiple image-generation datasets demonstrate the effectiveness and practicality of LoRA2D for securing copyrights in LoRA-adapted T2I diffusion models.

  1. [Aldhaheri et al., 2024] Lameya Aldhaheri, Noor Alshehhi, Irfana Ilyas Jameela Manzil, Ruhul Amin Khalil, Shu- maila Javaid, Nasir Saeed, and Mohamed-Slim Alouini. Lora communication for agriculture 4.0: Opportunities, challenges, and future directions. IEEE Internet of Things Journal, 2024.
  2. [Andrade and Yoo, 2019] Roberto Omar Andrade and Sang Guun Yoo. A comprehensive study of the use of lora in the development of smart cities. Applied Sciences, 9(22):4753, 2019.
  3. [Borji, 2022] Ali Borji. Generated faces in the wild: Quanti- tative comparison of stable diffusion, midjourney and dall- e 2. arXiv preprint arXiv:2210.00586, 2022.
  4. [Bui et al., 2023] Tu Bui, Shruti Agarwal, Ning Yu, and John Collomosse. Rosteals: Robust steganography using au- toencoder latent space. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 933-942, 2023.
  5. [Cao et al., 2024] Pu Cao, Feng Zhou, Qing Song, and Lu Yang. Controllable generation with text-to- image diffusion models: A survey. arXiv preprint arXiv:2403.04279, 2024.
  6. [Chou et al., 2023] Sheng-Yen Chou, Pin-Yu Chen, and Tsung-Yi Ho. How to backdoor diffusion models? In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4015-4024, 2023.
  7. [Feng et al., 2024] Weitao Feng, Wenbo Zhou, Jiyan He, Jie Zhang, Tianyi Wei, Guanlin Li, Tianwei Zhang, Weim- ing Zhang, and Nenghai Yu. Aqualora: Toward white-box protection for customized stable diffusion models via wa- termark lora. arXiv preprint arXiv:2405.11135, 2024.
  8. [Heusel et al., 2017] Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochre- iter. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems, 30, 2017.
  9. [Hu et al., 2022] Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen, et al. Lora: Low-rank adaptation of large language models. ICLR, 1(2):3, 2022.
  10. [Huan and Shun, 2025] Muchen Huan and Jianhong Shun. Fine-tuning transformers efficiently: A survey on lora and its impact. 2025. [Kalajdzievski, 2023]
  11. Damjan Kalajdzievski. A rank stabi- lization scaling factor for fine-tuning with lora. arXiv preprint arXiv:2312.03732, 2023.
  12. [Kwon, 2024] Dong-Hyun Kwon. Analysis of prompt ele- ments and use cases in image-generating ai: Focusing on midjourney, stable diffusion, firefly, dall• e. Journal of Digital Contents Society, 25(2):341-354, 2024.
  13. [Liu et al., 2023] Aiwei Liu, Leyi Pan, Xuming Hu, Shiao Meng, and Lijie Wen. A semantic invariant robust watermark for large language models. arXiv preprint arXiv:2310.06356, 2023.
  14. [Liu et al., 2024] Yihao Liu, Jinhe Huang, Yanjie Li, Dong Wang, and Bin Xiao. Generative ai model privacy: a sur- vey. Artificial Intelligence Review, 58(1):33, 2024.
  15. [Lu et al., 2024] Shilin Lu, Zihan Zhou, Jiayou Lu, Yuanzhi Zhu, and Adams Wai-Kin Kong. Robust watermarking us- ing generative priors against image editing: From bench- marking to advances. arXiv preprint arXiv:2410.18775, 2024.
  16. [Luo et al., 2025] Zihao Luo, Xilie Xu, Feng Liu, Yun Sing Koh, Di Wang, and Jingfeng Zhang. Privacy-preserving low-rank adaptation against membership inference attacks for latent diffusion models. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 5883-5891, 2025.
  17. [Ma et al., 2025] Zhiyuan Ma, Yuzhu Zhang, Guoli Jia, Liangliang Zhao, Yichao Ma, Mingjie Ma, Gaofeng Liu, Kaiyan Zhang, Ning Ding, Jianjun Li, et al. Efficient dif- fusion models: A comprehensive survey from principles to practices. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025.
  18. Norod78, ] Norod78. Simpsons-blip-captions. https://huggingface.co/datasets/Norod78/simpsons- blip-captions. Link
  19. [Parthasarathy et al., 2024] Venkatesh Balavadhani Parthasarathy, Ahtsham Zafar, Aafaq Khan, and Ar- salan Shahid. The ultimate guide to fine-tuning llms from basics to breakthroughs: An exhaustive review of technologies, research, best practices, applied re- search challenges and opportunities. arXiv preprint arXiv:2408.13296, 2024.
  20. [Radford et al., 2021] Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agar- wal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from nat- ural language supervision. In International conference on machine learning, pages 8748-8763. PmLR, 2021.
  21. [Ray and Roy, 2020] Arkadip Ray and Somaditya Roy. Re- cent trends in image watermarking techniques for copy- right protection: a survey. International Journal of Multi- media Information Retrieval, 9(4):249-270, 2020.
  22. [Rombach et al., 2022] Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684-10695, 2022.
  23. [Shen et al., 2025] Hui Shen, Jingxuan Zhang, Boning Xiong, Rui Hu, Shoufa Chen, Zhongwei Wan, Xin Wang, Yu Zhang, Zixuan Gong, Guangyin Bao, et al. Ef- ficient diffusion models: A survey. arXiv preprint arXiv:2502.06805, 2025.
  24. [Sundaram et al., 2019] Jothi Prasanna Shanmuga Sun- daram, Wan Du, and Zhiwei Zhao. A survey on lora networking: Research problems, current solutions, and open issues. IEEE Communications Surveys & Tutorials, 22(1):371-388, 2019.
  25. [Tu et al., 2024] Xiaoguang Tu, Zhi He, Yi Huang, Zhi-Hao Zhang, Ming Yang, and Jian Zhao. An overview of large ai models and their applications. Visual Intelligence, 2(1):34, 2024.
  26. [Varghese et al., 2016] Justin Varghese, Saudia Subash, Omer Bin Hussain, Krishnan Nallaperumal, Mo- hammed Ramadan Saady, and Mohamed Samiulla Khan. An improved digital image watermarking scheme using the discrete fourier transform and singular value decom- position. Turkish Journal of Electrical Engineering and Computer Sciences, 24(5):3432-3447, 2016.
  27. [Wang et al., 2025a] Zichong Wang, Zhipeng Yin, Zhen Liu, Roland HC Yap, Xiaocai Zhang, Shu Hu, and Wenbin Zhang. Redefining fairness: A multi-dimensional perspec- tive and integrated evaluation framework. In Joint Eu- ropean Conference on Machine Learning and Knowledge Discovery in Databases, pages 336-353. Springer, 2025.
  28. [Wang et al., 2025b] Zichong Wang, Zhipeng Yin, Liping Yang, Jun Zhuang, Rui Yu, Qingzhao Kong, and Wenbin Zhang. Fairness-aware graph representation learning with limited demographic information. In Joint European Con- ference on Machine Learning and Knowledge Discovery in Databases, pages 354-371. Springer, 2025.
  29. [Wang et al., 2026a] Zichong Wang, Zhipeng Yin, Zhong Chen, Jack Yang, Jun Liu, and Wenbin Zhang. Learn- ing counterfactual fairness from authentic generation. In Proceedings of the 35th International Joint Conference on Artificial Intelligence, 2026. IJCAI
  30. [Wang et al., 2026b] Zichong Wang, Zhipeng Yin, Mo Sha, Xiaofeng Gao, Xiaoli Li, and Wenbin Zhang. Towards fair graph learning without demographic supervision. In Proceedings of the 35th International Joint Conference on Artificial Intelligence, 2026. IJCAI
  31. [Wang et al., 2026c] Zichong Wang, Zhipeng Yin, and Wen- bin Zhang. A unified framework for fair graph generation: Theoretical guarantees and empirical advances. Advances in Neural Information Processing Systems, 38:64883- 64909, 2026.
  32. [Yang et al., 2024] Menglin Yang, Jialin Chen, Jinkai Tao, Yifei Zhang, Jiahong Liu, Jiasheng Zhang, Qiyao Ma, Harshit Verma, Regina Zhang, Min Zhou, et al. Low-rank adaptation for foundation models: A comprehensive re- view. arXiv preprint arXiv:2501.00365, 2024.
  33. [YaYaB, 2022] YaYaB. One piece blip captions. https: //huggingface.co/datasets/YaYaB/onepiece-blip-captions/, 2022. Link
  34. [Yin et al., 2025] Zhipeng Yin, Zichong Wang, Avash Pa- likhe, Zhen Liu, Jun Liu, and Wenbin Zhang. Amcr: A framework for assessing and mitigating copyright risks in generative models. 28th European Conference on Artifi- cial Intelligence, 2025.
  35. [Yin et al., 2026a] Zhipeng Yin, Zichong Wang, Zhong Chen, Jack Yang, Xin Ning, and Wenbin Zhang. Dis- entangled graph-enhanced large language models for fair learning. In Proceedings of the 35th International Joint Conference on Artificial Intelligence, 2026. IJCAI
  36. [Yin et al., 2026b] Zhipeng Yin, Zichong Wang, Weifeng Xu, Jun Zhuang, Pallab Mozumder, Antoinette Smith, and Wenbin Zhang. Digital Forensics in the Age of Large Lan- guage Models, pages 55-82. Springer Nature Switzerland, 2026.
  37. [Zhang and Ntoutsi, 2019] Wenbin Zhang and Eirini Ntoutsi. Faht: An adaptive fairness-aware decision tree classifier. In Proceedings of the Twenty-Eighth Interna- tional Joint Conference on Artificial Intelligence, pages 1480-1486. International Joint Conferences on Artificial Intelligence Organization, 2019. IJCAI
  38. [Zhang and Weiss, 2021] Wenbin Zhang and Jeremy C Weiss. Fair decision-making under uncertainty. In 2021 IEEE international conference on data mining (ICDM), pages 886-895. IEEE, 2021.
  39. [Zhang and Weiss, 2022] Wenbin Zhang and Jeremy C Weiss. Longitudinal fairness with censorship. In proceed- ings of the AAAI conference on artificial intelligence, vol- ume 36, 2022.
  40. [Zhang et al., 2018] Jialong Zhang, Zhongshu Gu, Jiyong Jang, Hui Wu, Marc Ph Stoecklin, Heqing Huang, and Ian Molloy. Protecting intellectual property of deep neural net- works with watermarking. In Proceedings of the 2018 on Asia conference on computer and communications secu- rity, pages 159-172, 2018.
  41. [Zhang et al., 2021] Wenbin Zhang, Liming Zhang, Dieter Pfoser, and Liang Zhao. Disentangled dynamic graph deep generation. In Proceedings of the 2021 SIAM International Conference on Data Mining (SDM). SIAM, 2021.
  42. [Zhang et al., 2023a] Qingru Zhang, Minshuo Chen, Alexander Bukharin, Nikos Karampatziakis, Pengcheng He, Yu Cheng, Weizhu Chen, and Tuo Zhao. Adalora: Adaptive budget allocation for parameter-efficient fine-tuning. arXiv preprint arXiv:2303.10512, 2023.
  43. [Zhang et al., 2023b] Wenbin Zhang, Tina Hernandez- Boussard, and Jeremy Weiss. Censored fairness through awareness. In Proceedings of the AAAI conference on artificial intelligence, 2023.
  44. [Zhang, 2024a] Wenbin Zhang. Ai fairness in practice: Paradigm, challenges, and prospects. Ai Magazine, 45(3):386-395, 2024.
  45. [Zhang, 2024b] Wenbin Zhang. Fairness with censorship: Bridging the gap between fairness research and real-world deployment. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, 2024.
  46. [Zhao et al., 2023] Yunqing Zhao, Tianyu Pang, Chao Du, Xiao Yang, Ngai-Man Cheung, and Min Lin. A recipe for watermarking diffusion models. arXiv preprint arXiv:2303.10137, 2023.
  47. [Zhou and Nabus, 2023] Kai-Qing Zhou and Hatem Nabus. The ethical implications of dall-e: Opportunities and chal- lenges. Mesopotamian Journal of Computer Science, 2023:16-21, 2023.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards