Applying a method of the cluster expansion developed in a study of statistical mechanics, a new mathematical model has been structured to account for the reason that a time series of transaction signs in financial markets has a long memory property. A basic assumption for the model was that investors split their hidden orders into small pieces before execution. The effect of public information also was taken into consideration. A mathematical expression of investors' investment behavior generates a discrete time stochastic process of cumulative transaction signs. The strong law of large numbers holds for the process: it converges to a trend term almost surely. The distribution of the fluctuation around the trend term weakly converges to the distribution of a superposition of a stochastic integral with respect to a Brownian motion and stochastic integrals with respect to a fractional Brownian motions with Hurst exponents greater than one-half. Namely, increments of the derived process have a long memory property.