In this work, we propose a multiphysics approach to simulate all-optical helicity-dependent switching induced by the local hot spots of plasmonic nanostructures. Due to the plasmonic resonance of an array of gold nanodisks, strong electromagnetic fields are generated within the magnetic recording media underneath the gold nanodisks. We construct a multiphysics framework considering the opto-magnetic and opto-thermal effects, and then model the magnetization switching using the Monte Carlo method. Our approach bridges the gap between plasmonic nanostructure design and magnetization switching modeling, allowing for the simulation of helicity-dependent, nanoscale magnetization switching in the presence of localized surface plasmons.