Multimodal data fusion AI model uncovers tumor microenvironment immunotyping heterogeneity and enhanced risk stratification of breast cancer

Abstract

Breast cancer is the leading cancer among women, with a significant number experiencing recurrence and metastasis, thereby reducing survival rates. This study focuses on the role of long noncoding RNAs (lncRNAs) in breast cancer immunotherapy response. We conducted an analysis involving 1027 patients from Sun Yat‐sen Memorial Hospital, Sun Yat‐sen University, and The Cancer Genome Atlas, utilizing RNA sequencing and pathology whole‐slide images. We employed unsupervised clustering to identify distinct lncRNA expression patterns and developed an AI‐based pathology model using convolutional neural networks to predict immune–metabolic subtypes. Additionally, we created a multimodal model integrating lncRNA data, immune‐cell scores, clinical information, and pathology images for prognostic prediction. Our findings revealed four unique immune–metabolic subtypes, and the AI model demonstrated high predictive accuracy, highlighting the significant impact of lncRNAs on antitumor immunity and metabolic states within the tumor microenvironment. The AI‐based pathology model, DeepClinMed‐IM, exhibited high accuracy in predicting these subtypes. Additionally, the multimodal model, DeepClinMed‐PGM, integrating pathology images, lncRNA data, immune‐cell scores, and clinical information, showed superior prognostic performance. In conclusion, these AI models provide a robust foundation for precise prognostication and the identification of potential candidates for immunotherapy, advancing breast cancer research and treatment strategies.