Advanced stellarators are typically optimized in two stages. The plasma equilibrium is optimized first, followed by the design of coils/permanent magnets. However, the coils/permanent magnets in the second stage may become too complex to achieve the desired equilibrium. To address this problem, a quasi-single-stage optimization method has been proposed. In this paper, we introduce this method for designing permanent magnet (PM) stellarators. The new approach combines straightforward PM metrics to penalize the maximum required PM thickness and the mismatch between the fixed-boundary equilibrium and the free-boundary one, along with typical physical targets. Since the degrees of freedom of the PMs are not included and directly used to minimize the objective function in this method, so we call it “quasi-single-stage” optimization. We apply this quasi-single-stage optimization method to find a new quasi-axisymmetric PM design. The new design starts from MUSE, which was initially designed using a two-stage optimization approach. The resulting design, MUSE++, exhibits an order of magnitude lower quasi-symmetric error and a one-order reduction in normal field error. We show that MUSE++ has approximately 30% fewer magnets compared to a proxy model “MUSE-0” that uses the same FAMUS optimization without the benefit of a single-stage equilibrium optimization. These results demonstrate that the new single-stage optimization method can concurrently improve plasma properties and simplify permanent magnet complexity.