This paper presents a new formulation of the second-order fourth-moment method (sometimes referred to as second-order perturbation method or second-order method of moments). The method allows to efficiently predict the stochastic moments of a response function and is therefore often used within robust design optimization. The new approach allows a non-intrusive implementation at the same cost as existing, highly intrusive formulations. Therefore, the new approach can be applied to any objective function without significant implementation effort. It is based on a few finite difference steps into special directions an hence is dependent on the corresponding step sizes. An automatic step size procedure is supplied beside an detailed convergence analysis. The advantages of the new formulation are demonstrated by robust design optimizations of a 2D and a 3D example using the geometrically nonlinear finite element method.