Breast cancer (BC) accounts for significant morbidity and mortality among women worldwide. About one in three patients with breast cancer present with lymph node (LN) metastasis and LN status is one of the most important prognostic predictors in patients with BC. In addition to their prognostic value, LNs initiate adaptive immunity against BC. Yet, BC cells often avoid immune-mediated destruction in LNs. This review provides an overview of the ways by which BC cells modulate LN stromal and hematopoietic cells to promote metastasis and immune evasion.