Transient solution of a fractional stochastic dynamical system under wide-band noise excitation is investigated. Generalized Harmonic Balance technique is firstly used to approximate restoring force of the given system as an amplitude-dependent form. In this way, stochastic averaging method then can be applied to transform the system into an Ito differential equation. Furthermore, the fractional derivative in the integral-differential form can be equivalent to a combination of periodic functions after the averaging procedure. As the following, Galerkin method therein is utilized to obtain the transient probability density functions by solving associated Fokker-Planck-Kolmogorov (FPK) equation. As an example, the Rayleigh oscillator is studied to illustrate the efficiency and accuracy of the proposed approaches. Numerical results show that exact stationary solution and transient solution derived from Galerkin method are in good agreement with those from Monte Carlo Simulation.