Biochemical reaction systems involve many different species interacting via many different reaction channels. When the number of species and the abundance of species are so high, pure modeling approaches based on differential equations suffer from curse of dimensionality. If a system involves conserved cycles, abundances of some species can be obtained via algebraic relations which in turn will reduce the dimension of differential equations representing the dynamics of the system. In the present paper, we propose a numerical algorithm that uses Gauss-Jordan method to obtain conserved cycles in biochemical systems. We give this algorithm in Direct Method (DM), First Reaction Method (FRM) and Next Reaction Method (NRM) which obtain exact realizations of the state vector in stochastic modeling approach. We apply these three algorithms with/without using conservation relations to biochemical systems in different sizes and compare the computational costs of two different versions of each exact algorithm.