Rosai-Dorfman disease (RDD) is an idiopathic, benign proliferation of histiocytes that can be present in multiple organs such as lymph node, skin, soft tissue, orbit, central nerve system and bone; however, it rarely occurs in the breast. In general, RDD is a painless, firm and poorly defined lesion, which can radiologically mimic a breast cancer and is therefore an important consideration. The diagnosis of breast RDD is challenging, especially on a small biopsy specimen. We report a unique case of breast RDD with a literature review including common presentation, differential diagnosis, and recommended management. A high index of suspicion for this rare entity is essential to render a correct diagnosis, thereby avoiding unnecessary diagnostic tests and treatment.