It is known that hydroxyapatite-type calcium phosphate cement (CPC) shows appreciable self-curing properties, but the phase transformation products often lead to slow biodegradation and disappointing osteogenic responses. Herein, we developed an innovative strategy to endow invisible micropore networks, which could tune the microstructures and biodegradation of α-tricalcium phosphate (α-TCP)-based CPC by gypsum fibers, and the osteogenic capability of the composite cements could be enhanced in vivo. The gypsum fibers were prepared via extruding the gypsum powder/carboxylated chitosan (CC) slurry through a 22G nozzle (410 μm in diameter) and collecting with a calcium salt solution. Then, the CPCs were prepared by mixing the α-TCP powder with gypsum fibers (0−24 wt %) and an aqueous solution to form self-curing cements. The physicochemical characterizations showed that injectability was decreased with an increase in the fiber contents. The μCT reconstruction demonstrated that the gypsum fiber could be distributed in the CPC substrate and produce long-range micropore architectures. In particular, incorporation of gypsum fibers would tune the ion release, produce tunnel-like pore networks in vitro, and promote new bone tissue regeneration in rabbit femoral bone defects in vivo. Appropriate gypsum fibers (16 and 24 wt %) could enhance bone defect repair and cement biodegradation. These results demonstrate that the highly biodegradable cement fibers could mediate the microstructures of conventional CPC biomaterials, and such a bicomponent composite strategy may be beneficial for expanding clinical CPC-based applications.