The explosive growth of broadband applications calls for large-scale optical cross-connects (OXCs). However, the classical wavelength selective switch (WSS) based OXC is not scalable in terms of the size of employed WSSs and the cabling complexity. To solve this problem, we propose a three-phase approach to construct a modular WSS-based OXC. In phase 1, we factorize the interconnection network between the input stage and the output stage of the traditional OXC into a set of smallsize interconnection networks. In phase 2, we decompose each WSS into a two-stage cascaded structure of small-size WSSs. In phase 3, we combine the small-size interconnection networks with the small-size WSSs to form a set of small-size OXC modules. At last, we obtain a modular OXC, which is a network of smallsize OXCs. Similar to the classical OXC, the modular OXC is nonblocking at each wavelength and possesses a self-routing property. Our analysis shows that the modular OXC has small cabling complexity and acceptable physical-layer performance.