In this work, a CuCe alloy was prepared using a directional solidification method at a series of withdrawal rates of 100, 25, 10, 8, and 5 μm/s. We found that the primary phase microstructure transforms from cellular crystals to cellular peritectic coupled growth and eventually, changes into dendrites as the withdrawal rate increases. The phase constituents in the directionally solidified samples were confirmed to be Cu2Ce, CuCe, and CuCe + Ce eutectics. The primary dendrite spacing was significantly refined with an increasing withdrawal rate, resulting in higher compressive strength and strain. Moreover, the cellular peritectic coupled growth at 10 μm/s further strengthened the alloy, with its compressive property reaching the maximum value of 266 MPa. Directional solidification was proven to be an impactful method to enhance the mechanical properties and produce well-aligned in situ composites in peritectic systems.