Undifferentiated carcinomas are highly aggressive tumors with a dismal prognosis. A subset of these tumors has been associated with inactivation or mutations of the Switch/Sucrose Nonfermenting (SWI/SNF) remodeling complex. Our understanding of the relationship between the clinicopathological features and molecular profiling of SWI/SNF-deficient undifferentiated carcinoma is still evolving due to its rarity. We herein present a rare tumor of undifferentiated carcinoma with SMARCB1/INI1 deficiency arising from the colon. The histology revealed a tumor composed of sheets of discohesive, high-grade epithelioid cells with rhabdoid morphology along with anaplastic giant cells. Additionally, there was a significant infiltration of inflammatory cells in the background. Immunohistochemical (IHC) analysis supported the diagnosis of carcinoma with loss of INI1 expression, the tumor was mismatch repair protein proficient. Molecular analysis demonstrated an oncogenic KRAS mutation (p.G12D), whereas it was wild-type BRAF, and wild-type NRAS. The diagnosis of SWI/SNF-deficient undifferentiated carcinoma can be challenging. Correlation with clinical findings, in conjunction with IHC work-up and molecular analysis, is of utmost importance to arrive at the appropriate diagnosis and exclude potential mimics.