We obtain holographically renormalized boundary stress tensor with the emphasis on a special point in the parameter space of three dimensional new massive gravity, using the so-called Fefferman-Graham coordinates with relevant counter terms. Through the linearized equations of motion with a standard prescription, we also obtain correlators among these stress tensors. We argue that the self-consistency of holographic renormalization determines counter terms up to unphysical ambiguities. Using this renormalized stress tensor in Fefferman-Graham coordinates, we obtain the central charges of dual CFT, and mass and angular momentum of some AdS black hole solutions. These results are consistent with the previous ones obtained by other methods. In this study on the Fefferman-Graham expansion of new massive gravity, some aspects of higher curvature gravity are revealed.