Water has emerged as a versatile solvent for organic chemistry in recent years due to its abundance, low cost, and environmental friendliness. However, one of the most important reactions, the aldol reaction, in the presence of excess water exhibits low yields and poor enantioselectivities. In this regard, we have employed a multiscale modeling approach to investigate the aldol addition reaction catalyzed by L-proline in the hydrophobic compartment of multicompartment micelle (MCM) nanoreactor consisting of amphiphilic bottlebrush copolymer, which minimizes the water content at the reactive site. Through performing dissipative particle dynamics (DPD) simulation, it is found that the "clover-like" morphology of the MCM is formed from multiblock copolymer with a sequence of ethylene oxide-based hydrophilic blocks, styrene lipophilic blocks, L-proline catalyst blocks, and a pentafluorostyrene fluorophilic block in aqueous media. We find that the vicinity of the catalyst in the clover-like MCM has a low dielectric environment, which could facilitate the aldol addition reaction. Our DFT calculations demonstrate that the asymmetric aldol addition of L-proline-catalyzed acetone and 4-nitrobenzaldehyde is energetically more favorable under the low dielectric environment in MCM compared with other commonly used solvents such as DMSO, water, and vacuum condition.