The purpose of this paper is to introduce and study a notion of pre-Jordan algebra. Pre-Jordan algebras are regarded as the underlying algebraic structures of the Jordan algebras with a nondegenerate symplectic form. They are the algebraic structures behind the Jordan Yang-Baxter equation and Rota-Baxter operators in terms of O -operators of Jordan algebras introduced in this paper. Pre-Jordan algebras are analogues for Jordan algebras of pre-Lie algebras and fit into a bigger framework with a close relationship with dendriform algebras. The anticommutator of a preJordan algebra is a Jordan algebra and the left multiplication operators give a representation of the Jordan algebra, which is the beauty of such a structure. Furthermore, we introduce a notion of O -operator of a pre-Jordan algebra which gives an analogue of the classical Yang-Baxter equation in a pre-Jordan algebra.