In this paper, an adaptive neural output-feedback control approach is considered for a class of uncertain multi-input and multi-output (MIMO) stochastic nonlinear systems with unknown control directions. Neural networks (NNs) are applied to approximate unknown nonlinearities, and K-filter observer is designed to estimate unavailable system's states. Due to utilization of Nussbaum gain function technique in the proposed approach, the singularity problem and requirement to prior knowledge about signs of high-frequency gains are removed, simultaneously. Razumikhin functional method is employed to deal with unknown state time-varying delays, so that the offered control approach is free of common assumptions on derivative of time-varying delays. Also, an adaptive neural dynamic surface control is developed; hence, explosion of complexity in conventional backstepping method is eliminated, effectively. The boundedness of all the resulting closed-loop signals is guaranteed in probability; meanwhile, convergence of the tracking errors to adjustable compact set in the sense of mean quartic value is also proved. Finally, simulation results are shown to verify and clarify efficiency of the offered approach.