Abstract:As an innovation technique, Augmented Reality (AR) has been gradually deployed in the broadcast, videography and cinematography industries. Virtual graphics generated by AR are dynamic and overlap on the surface of the environment so that the original appearance can be greatly enhanced in comparison with traditional broadcasting. In addition, AR enables broadcasters to interact with augmented virtual 3D models on a broadcasting scene in order to enhance the performance of broadcasting. Recently, advanced robotic technologies have been deployed in a camera shooting system to create a robotic cameraman so that the performance of AR broadcasting could be further improved, which is highlighted in the paper.
Plane is one of the most important element for indoor man-made structural rooms, such as broadcasting studios, open lecture room and empty offices. The existing visual mapping algorithms cannot effectively detect and describe the visual features on an empty large or medium size plane. This article aims to introduce a novel frame-to-frame registration pipeline based on one medium-size plane on man-made object instead of multiple planes or small plane patches. By introducing a structural description of reference planar area with its contour data and CNN segmentation information, the proposed approach is able track the pose of camera with high accuracy and robustness in comparison with existing feature-based tracking or dense geometric tracking approaches.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.