Fibromatosis of the breast is a rare benign disease compromising <0.2% of all primary breast tumors. Although the chest wall is a common location, occurrences of implant-associated fibromatosis of the breast are extremely rare; only 33 cases have been reported. We present a case of a 42-year-old female who underwent breast augmentation with silicone breast implants, and 2 years later developed an aggressive implant-associated fibromatosis of the breast and chest wall. On imaging studies, the tumor mimicked breast carcinoma, and despite chemotherapy, the fibromatosis rapidly enlarged and was locally invasive requiring wide surgical excision. Unlike previously reported imaging findings, magnetic resonance imaging revealed an oval circumscribed mass with fringe-like internal architecture. We provide a review of the literature and discuss the imaging features of implant-associated fibromatosis of the breast.