The statistical analysis for equations driven by fractional Gaussian process (fGp) is relatively recent. The development of stochastic calculus with respect to the fGp allowed to study such models. In the present paper we consider the drift parameter estimation problem for the non-ergodic Ornstein-Uhlenbeck process defined as dX t = θX t dt + dG t , t ≥ 0 with an unknown parameter θ > 0, where G is a Gaussian process. We provide sufficient conditions, based on the properties of G, ensuring the strong consistency and the asymptotic distribution of our estimator θ t of θ based on the observation {X s , s ∈ [0, t]} as t → ∞. Our approach offers an elementary, unifying proof of [4], and it allows to extend the result of [4] to the case when G is a fractional Brownian motion with Hurst parameter H ∈ (0, 1). We also discuss the cases of subfractional Brownian motion and bifractional Brownian motion.