Proceedings

SMILE: A Scale-aware Multiple Instance Learning Method for Multicenter STAS Lung Cancer Histopathology Diagnosis

Download BibTeX Cite

Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence. AI and Social Good. Pages 9836-9844.

https://doi.org/10.24963/ijcai.2025/1093

Abstract

Spread through air spaces (STAS) represents a newly identified aggressive pattern in lung cancer, which is known to be associated with adverse prognostic factors and complex pathological features. Pathologists currently rely on time-consuming manual assessments, which are highly subjective and prone to variation. This highlights the urgent need for automated and precise diagnostic solutions. 2,970 lung cancer tissue slides are comprised from multiple centers, re-diagnosed them, and constructed and publicly released three lung cancer STAS datasets: STAS-CSU (hospital), STAS-TCGA, and STAS-CPTAC. All STAS datasets provide corresponding pathological feature diagnoses and related clinical data. To address the bias, sparse and heterogeneous nature of STAS, we propose an scale-aware multiple instance learning(SMILE) method for STAS diagnosis of lung cancer. By introducing a scale-adaptive attention mechanism, the SMILE can adaptively adjust high-attention instances, reducing over-reliance on local regions and promoting consistent detection of STAS lesions. Extensive experiments show that SMILE achieved competitive diagnostic results on STAS-CSU, diagnosing 251 and 319 STAS samples in CPTAC and TCGA, respectively, surpassing clinical average AUC. The 11 open baseline results are the first to be established for STAS research, laying the foundation for the future expansion, interpretability, and clinical integration of computational pathology technologies. The datasets and code are available at https://github.com/panliangrui/IJCAI25.

  1. [Borkowski et al., 2019] Andrew A Borkowski, Marilyn M Bui, L Brannon Thomas, Catherine P Wilson, Lauren A DeLand, and Stephen M Mastorides. Lung and colon cancer histopathological image dataset (lc25000). arXiv preprint arXiv:1912.12142, 2019.
  2. [Cen et al., 2024] Min Cen, Zheng Wang, Zhenfeng Zhuang, Hong Zhang, Dan Su, Zhen Bao, Weiwei Wei, Bap- tiste Magnier, Lequan Yu, and Liansheng Wang. Or- cgt: Ollivier-ricci curvature-based graph model for lung stas prediction. In International Conference on Medi- cal Image Computing and Computer-Assisted Interven- tion, pages 553-563. Springer, 2024.
  3. [Chae et al., 2021] Mincheol Chae, Jae Hyun Jeon, Jin- Haeng Chung, So Young Lee, Wan Jin Hwang, Woohyun Jung, Yoohwa Hwang, Sukki Cho, Kwhanmien Kim, and Sanghoon Jheon. Prognostic significance of tumor spread through air spaces in patients with stage ia part-solid lung adenocarcinoma after sublobar resection. Lung Cancer, 152:21-26, 2021.
  4. [Eguchi et al., 2019] Takashi Eguchi, Koji Kameda, Shao- hua Lu, Matthew J Bott, Kay See Tan, Joseph Monte- calvo, Jason C Chang, Natasha Rekhtman, David R Jones, William D Travis, et al. Lobectomy is associated with bet- ter outcomes than sublobar resection in spread through air spaces (stas)-positive t1 lung adenocarcinoma: a propen- sity score-matched analysis. Journal of thoracic oncology, 14(1):87-98, 2019.
  5. [Feng et al., 2024] Yipeng Feng, Hanlin Ding, Xing Huang, Yijian Zhang, Mengyi Lu, Te Zhang, Hui Wang, Yuzhong Chen, Qixing Mao, Wenjie Xia, et al. Deep learning-based detection and semi-quantitative model for spread through air spaces (stas) in lung adenocarcinoma. NPJ Precision Oncology, 8(1):173, 2024.
  6. [Gutman et al., 2017] David A Gutman, Mohammed Khalilia, Sanghoon Lee, Michael Nalisnik, Zach Mullen, Jonathan Beezley, Deepak R Chittajallu, David Manthey, and Lee AD Cooper. The digital slide archive: a software platform for management, integration, and analysis of histology for cancer research. Cancer research, 77(21):e75-e78, 2017.
  7. [Han et al., 2021] Yeon Bi Han, Hyojin Kim, Mari Mino- Kenudson, Sukki Cho, Hyun Jung Kwon, Ki Rim Lee, Soohyeon Kwon, Jeonghyo Lee, Kwhanmien Kim, Sanghoon Jheon, et al. Tumor spread through air spaces (stas): prognostic significance of grading in non-small cell lung cancer. Modern Pathology, 34(3):549-561, 2021.
  8. [Heath et al., 2021] Allison P Heath, Vincent Ferretti, Stuti Agrawal, Maksim An, James C Angelakos, Renuka Arya, Rosita Bajari, Bilal Baqar, Justin HB Barnowski, Jeffrey Burt, et al. The nci genomic data commons. Nature genet- ics, 53(3):257-262, 2021.
  9. [Hou et al., 2016] Le Hou, Dimitris Samaras, Tahsin M Kurc, Yi Gao, James E Davis, and Joel H Saltz. Patch- based convolutional neural network for whole slide tissue image classification. In Proceedings of the IEEE confer- ence on computer vision and pattern recognition, pages 2424-2433, 2016.
  10. [Ilse et al., 2018] Maximilian Ilse, Jakub Tomczak, and Max Welling. Attention-based deep multiple instance learning. In International conference on machine learning, pages 2127-2136. PMLR, 2018.
  11. [Jaume et al., 2024] Guillaume Jaume, Anurag Vaidya, An- drew Zhang, Andrew H. Song, Richard J. Chen, Sharifa Sahai, Dandan Mo, Emilio Madrigal, Long Phi Le, and Faisal Mahmood. Multistain pretraining for slide repre- sentation learning in pathology. In European Conference on Computer Vision, pages 19-37. Springer, 2024.
  12. [Jothi and Rajam, 2016] J Angel Arul Jothi and V Mary Anita Rajam. Effective segmentation and classification of thyroid histopathology images. Applied Soft Computing, 46:652-664, 2016.
  13. [Khalil et al., 2023] Hassan A Khalil, Weiwei Shi, Emanuele Mazzola, Daniel Nahum Lee, Emily Norton-Hughes, Daniel Dolan, Samantha Corman, Abby White, Lynette M Sholl, and Scott J Swanson. Analysis of recurrence in lung adenocarcinoma with spread through air spaces. The Journal of Thoracic and Cardiovascular Surgery, 166(5):1317-1328, 2023.
  14. [Li et al., 2021] Bin Li, Yin Li, and Kevin W Eliceiri. Dual- stream multiple instance learning network for whole slide image classification with self-supervised contrastive learn- ing. In Proceedings of the IEEE/CVF conference on com- puter vision and pattern recognition, pages 14318-14328, 2021.
  15. [Lin et al., 2023] Tiancheng Lin, Zhimiao Yu, Hongyu Hu, Yi Xu, and Chang-Wen Chen. Interventional bag multi- instance learning on whole-slide pathological images. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19830-19839, 2023.
  16. [Lin et al., 2024] Mong-Wei Lin, Li-Wei Chen, Shun-Mao Yang, Min-Shu Hsieh, De-Xiang Ou, Yi-Hsuan Lee, Jin- Shing Chen, Yeun-Chung Chang, and Chung-Ming Chen. Ct-based deep-learning model for spread-through-air- spaces prediction in ground glass-predominant lung ade- nocarcinoma. Annals of Surgical Oncology, 31(3):1536- 1545, 2024.
  17. [Lu et al., 2017] Shaohua Lu, Kay See Tan, Kyuichi Kadota, Takashi Eguchi, Sarina Bains, Natasha Rekhtman, Prasad S Adusumilli, and William D Travis. Spread through air spaces (stas) is an independent predictor of re- currence and lung cancer-specific death in squamous cell carcinoma. Journal of Thoracic Oncology, 12(2):223-234, 2017.
  18. [Lu et al., 2021] Ming Y Lu, Drew FK Williamson, Tiffany Y Chen, Richard J Chen, Matteo Barbieri, and Faisal Mahmood. Data-efficient and weakly supervised computational pathology on whole-slide images. Nature biomedical engineering, 5(6):555-570, 2021.
  19. [Lu et al., 2023] Ming Y Lu, Bowen Chen, Andrew Zhang, Drew FK Williamson, Richard J Chen, Tong Ding, Long Phi Le, Yung-Sung Chuang, and Faisal Mahmood. Visual language pretrained multiple instance zero-shot transfer for histopathology images. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 19764-19775, 2023.
  20. [Onozato et al., 2013] Maristela L Onozato, Alexandra E Kovach, Beow Y Yeap, Vicente Morales-Oyarvide, Veron- ica E Klepeis, Swathi Tammireddy, Rebecca S Heist, Eu- gene J Mark, Dora Dias-Santagata, A John Iafrate, et al. Tumor islands in resected early-stage lung adenocarci- nomas are associated with unique clinicopathologic and molecular characteristics and worse prognosis. The Amer- ican journal of surgical pathology, 37(2):287-294, 2013.
  21. [Pan et al., 2024] Liangrui Pan, Qingchun Liang, Wenwu Zeng, Yijun Peng, Zhenyu Zhao, Yiyi Liang, Jiadi Luo, Xiang Wang, and Shaoliang Peng. Feature-interactive siamese graph encoder-based image analysis to predict stas from histopathology images in lung cancer. NPJ Pre- cision Oncology, 8(1):285, 2024.
  22. [Shao et al., 2021] Zhuchen Shao, Hao Bian, Yang Chen, Yifeng Wang, Jian Zhang, Xiangyang Ji, et al. Transmil: Transformer based correlated multiple instance learning for whole slide image classification. Advances in neural information processing systems, 34:2136-2147, 2021.
  23. [Shi et al., 2024] Jiangbo Shi, Chen Li, Tieliang Gong, Chunbao Wang, and Huazhu Fu. Cod-mil: Chain-of- diagnosis prompting multiple instance learning for whole slide image classification. IEEE Transactions on Medical Imaging, 2024.
  24. [Shiono and Yanagawa, 2016] Satoshi Shiono and Naoki Yanagawa. Spread through air spaces is a predictive fac- tor of recurrence and a prognostic factor in stage i lung adenocarcinoma. Interactive cardiovascular and thoracic surgery, 23(4):567-572, 2016.
  25. [Wang et al., 2022] Xiyue Wang, Sen Yang, Jun Zhang, Minghui Wang, Jing Zhang, Wei Yang, Junzhou Huang, and Xiao Han. Transformer-based unsupervised con- trastive learning for histopathological image classification. Medical image analysis, 81:102559, 2022.
  26. [Wang et al., 2023] Joshua M Wang, Runyu Hong, Eliza- beth G Demicco, Jimin Tan, Rossana Lazcano, Andre L Moreira, Yize Li, Anna Calinawan, Narges Razavian, To- bias Schraink, et al. Deep learning integrates histopathol- ogy and proteogenomics at a pan-cancer level. Cell Re- ports Medicine, 4(9), 2023.
  27. [Warth et al., 2015] Arne Warth, Thomas Muley, Claudia A Kossakowski, Benjamin Goeppert, Peter Schirmacher, Hendrik Dienemann, and Wilko Weichert. Prognostic im- pact of intra-alveolar tumor spread in pulmonary adeno- carcinoma. The American journal of surgical pathology, 39(6):793-801, 2015.
  28. [Xiang and Zhang, 2023] Jinxi Xiang and Jun Zhang. Ex- ploring low-rank property in multiple instance learning for whole slide image classification. In The Eleventh Interna- tional Conference on Learning Representations, 2023.
  29. [Xue et al., 2021] Yuan Xue, Jiarong Ye, Qianying Zhou, L Rodney Long, Sameer Antani, Zhiyun Xue, Carl Corn- well, Richard Zaino, Keith C Cheng, and Xiaolei Huang. Selective synthetic augmentation with histogan for im- proved histopathology image classification. Medical im- age analysis, 67:101816, 2021.
  30. [Yao et al., 2020] Jiawen Yao, Xinliang Zhu, Jitendra Jonna- gaddala, Nicholas Hawkins, and Junzhou Huang. Whole slide images based cancer survival prediction using at- tention guided deep multiple instance learning networks. Medical Image Analysis, 65:101789, 2020.
  31. [Zhang et al., 2022] Hongrun Zhang, Yanda Meng, Yitian Zhao, Yihong Qiao, Xiaoyun Yang, Sarah E Coupland, and Yalin Zheng. Dtfd-mil: Double-tier feature distillation multiple instance learning for histopathology whole slide image classification. In Proceedings of the IEEE/CVF con- ference on computer vision and pattern recognition, pages 18802-18812, 2022.
  32. [Zhang et al., 2024] Yunlong Zhang, Honglin Li, Yunxuan Sun, Sunyi Zheng, Chenglu Zhu, and Lin Yang. Attention- challenging multiple instance learning for whole slide im- age classification. In European Conference on Computer Vision, pages 125-143. Springer, 2024.
  33. [Zhao et al., 2020] Yu Zhao, Fan Yang, Yuqi Fang, Hailing Liu, Niyun Zhou, Jun Zhang, Jiarui Sun, Sen Yang, Bjoern Menze, Xinjuan Fan, et al. Predicting lymph node metas- tasis using histopathological images based on multiple in- stance learning with deep graph convolution. In Proceed- ings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4837-4846, 2020.
  34. [Zhou et al., 2022] Fang Zhou, Julian A Villalba, Treah May S Sayo, Navneet Narula, Harvey Pass, Mari Mino- Kenudson, and Andre L Moreira. Assessment of the feasi- bility of frozen sections for the detection of spread through air spaces (stas) in pulmonary adenocarcinoma. Modern Pathology, 35(2):210-217, 2022.
  35. [Zhu et al., 2024] Wenhui Zhu, Xiwen Chen, Peijie Qiu, Aristeidis Sotiras, Abolfazl Razi, and Yalin Wang. Dgr- mil: Exploring diverse global representation in multiple instance learning for whole slide image classification. In European Conference on Computer Vision, pages 333- 351. Springer, 2024.

References were extracted automatically from the PDF and may contain errors.

Welcome Future Conferences AI Journal Division IJCAI Proceedings About IJCAI IJCAI Awards