Offshore floating wind turbines (FWT) decrease climate change adversial effects without occupying significant land and harvesting fields. Owing to the earth planet unexpected climate, online adaptive feedback control of FWTs will be effective in the sense of optimal and uniform energy capture. In this paper, a deep reinforcement learning (DRL)-based control system is proposed to offset both the disturbance and noise effects. Large variations of wind and water waves generate enormous information give rise to convergent learning of deep neural networks model of the wind turbine. As a result of the disturbance and wind sudden variations, an adaptive inverse control equipped with DRL could easily cope with the inherent drawback of DRL i.e., tracking error. Furthermore, received rewards in the DRL algorithm are passed through the newly designed training algorithm to predict control actions such that the loss function is decreased. The attenuation of disturbance and noise on the tracking performance of closed-loop FWT is clarified through software implementation tests while the weight's convergency and update rules are proved by the direct Lyapunov theorem.