Cancer-associated adipocytes are known to cause inflammation, leading to cancer progression and metastasis. The clinicopathological and transcriptomic data from 2256 patients with breast cancer were obtained based on three cohorts: The Cancer Genome Atlas (TCGA), GSE25066, and a study by Yau et al. For the current study, we defined the adipocyte, which is calculated by utilizing a computational algorithm, xCell, as “intratumoral adipocyte”. These intratumoral adipocytes appropriately reflected mature adipocytes in a bulk tumor. The amount of intratumoral adipocytes demonstrated no relationship with survival. Intratumoral adipocyte-high tumors significantly enriched for metastasis and inflammation-related gene sets and are associated with a favorable tumor immune microenvironment, especially in the ER+/HER2- subtype. On the other hand, intratumoral adipocyte-low tumors significantly enriched for cell cycle and cell proliferation-related gene sets. Correspondingly, intratumoral adipocyte-low tumors are associated with advanced pathological grades and inversely correlated with MKI67 expression. In conclusion, a high amount of intratumoral adipocytes in breast cancer was associated with inflammation, metastatic pathways, cancer stemness, and favorable tumor immune microenvironment. However, a low amount of adipocytes was associated with a highly proliferative tumor in ER-positive breast cancer. This cancer biology may explain the reason why patient survival did not differ by the amount of adipocytes.