Intra-tumor heterogeneity (ITH) is a fundamental characteristic of breast cancer (BC), influencing tumor progression, prognosis, and therapeutic responses. However, the complexity of ITH in BC makes its accurate characterization challenging. This study leverages deep learning (DL) techniques to comprehensively evaluate ITH in early-stage luminal BC and provide a nuanced understanding of its impact on tumor behavior and patient outcomes. A large cohort (n = 2561) of early-stage luminal BC was evaluated using whole slide images (WSIs) of hematoxylin and eosin-stained slides of excision specimens. Morphological features of both the tumor and stromal components were meticulously annotated by a panel of pathologists in a subset of cases. A DL model was applied to develop an algorithm to assess the degree of heterogeneity of various morphological features per individual case utilizing defined patches. The results of extracted features were used to generate an overall heterogeneity score that was correlated with the clinicopathological features and outcome. Overall, 162 features were quantified and a significant positive correlation between these features was identified. Specifically, there was a significant association between a high degree of intra-tumor heterogeneity and larger tumor size, poorly differentiated tumors, highly proliferative tumors, tumors of no special type (NST), and those with low estrogen receptor (ER) expression. When all features are considered in combination, a high overall heterogeneity score was significantly associated with parameters characteristic of aggressive tumor behavior, and it was an independent predictor of poor patient outcome. In conclusion, DL models can be used to accurately decipher the complexity of ITH and provide extra information for outcome prediction.
