Male breast cancer is rare, comprising only 1% of all mammary cancers; invasive ductal carcinoma is by far the commonest subtype in both men and women. Though lobular breast cancer is the second most common subtype seen in women, such cancers are extremely uncommon in men, and this is likely related to the lack of lobular development in the male breast. Thus, due to the rarity of this subtype among breast cancers, compounded by the overall rarity of breast cancer in men, current understanding of the pathogenesis of this disease and its management is largely derived from case series and extrapolation of information from the larger cohort of female patients. This paper provides a systematic review on invasive lobular carcinoma of the male breast in the context of an illustrative case study. A comprehensive analysis of the National Cancer Institute’s Surveillance, Epidemiology, and End Results Data 1973–2013 leading to an exploration of the pathogenesis, epidemiology, clinical presentation, diagnosis, tumor characteristics, and management of lobular breast carcinoma in men is also discussed. Lobular subtype of breast cancer remains an enigmatic elusive disease that needs additional research to unravel its overall pathogenesis and molecular profile to provide insight for improved therapeutic management options.