Proper biogenesis of a sperm-specific organelle, the acrosome, is essential for gamete interaction. An acrosomal matrix protein, ACRBP, is known as a proacrosin-binding protein. In mice, two forms of ACRBP, wild-type ACRBP-W and variant ACRBP-V5, are generated by pre-mRNA alternative splicing of Acrbp. Here, we demonstrate the functional roles of these two ACRBP proteins. ACRBP-null male mice lacking both proteins showed a severely reduced fertility, because of malformation of the acrosome. Notably, ACRBP-null spermatids failed to form a large acrosomal granule, leading to the fragmented structure of the acrosome. The acrosome malformation was rescued by transgenic expression of ACRBP-V5 in ACRBP-null spermatids. Moreover, exogenously expressed ACRBP-W blocked autoactivation of proacrosin in the acrosome. Thus, ACRBP-V5 functions in the formation and configuration of the acrosomal granule during early spermiogenesis. The major function of ACRBP-W is to retain the inactive status of proacrosin in the acrosome until acrosomal exocytosis.