We propose real-time interactive game that is based on Augmented Reality (AR). It is composed of AR marker, Head Mounted Display and depth camera. By using marker, the proposed system augments game space, fishing place. And player can interact virtual game object such as bait or fish with bare hands based on computer vision. The rapid development of AR technologies has raised profound interests in the design of AR games, but the existing games have not provided realistically felt game environments because the way to play games remains the same when the platform is changed. In addition, studies in this field did not fully utilize AR technologies, so that inherent characteristics of AR game do not impact user experience and draw attention explicitly on design concepts. Our system gives the experience that is grasping the virtual objects. Also, it can be applied to various game contents that are actually felt as real.