Different from previously reported co-amorphous systems, a co-amorphous curcumin-magnolol (CUR-MAG CM) system, as compared with its crystalline counterparts, exhibited decreased dissolution due to its aggregation during dissolution. The main purpose of the present study is to deaggregate CUR-MAG CM to optimize drug dissolution and explore the deaggregation mechanism involved. Herein, a small amount of polymer (HPMC, HPC, and PVP K30) was co-formulated at 5% (w/w) with CUR-MAG CM as ternary co-amorphous systems. The polymer addition changed the surface properties of CUR-MAG CM including improved water wettability enhanced surface free energy, and hence exerted a deaggregating effect. As a result, the ternary co-amorphous systems showed faster and higher dissolution as compared with crystalline CUR/MAG and CUR-MAG CM. In addition, the nucleation and crystal growth of dissolved CUR and MAG molecules were significantly inhibited by the added polymer, maintaining a supersaturated concentration for a long time. Furthermore, polymer addition increased the Tg of CUR-MAG CM, potentially involving molecular interactions and inhibiting molecular mobility, resulting in enhanced physical stability under 25 °C/60% RH and 40 °C/75% RH conditions. Therefore, this study provides a promising strategy to optimize the dissolution and physical stability of co-amorphous systems by deaggregation and crystallization inhibition via adding small amounts of polymers.