In theory, the relative pose between the object and the camera can be uniquely estimated from a minimum of four coplanar but noncollinear target points. In practice, the observed image points are always perturbed by homogeneous Gaussian noise, and the pose ambiguities are easily happened. In this paper, an iterative refinement approach with a robust filter strategy is proposed.It utilizes the pose parameters obtained from non-iterative pose estimation algorithms as initialization to perform undistortion and unprojection of original images to a canonical fronto-parallel plane. This canonical plane is then used to localize the target points and recompute the pose parameters in an iterative refinement until convergence. Based on this solution, we derive a refinement algorithm which increases the accuracy of target points localization and consequently of pose estimation from a planar target. Besides, the filter strategy adopts the geometric error instead of algebraic error in the pose selection. The advantages of our method are demonstrated by through testing on both synthetic and real data.