A Framework for Augmented Reality Using Non-Central Catadioptric Cameras

Abstract

In this article we propose a framework for the application of augmented reality to non-central catadioptric imaging devices. Considering a virtual object in the world with known 3D coordinates, the goal is to project this object into the image of a non-central catadioptric camera. We propose a solution to this problem which allows us to project texturized objects to the image in realtime, up to 20 fps: projection of 3D segments to the image; occlusions; illumination and shading. To the best of our knowledge this is the first time that this problem is addressed (all state-of-the-art methods are derived for central camera systems). In our experiments, we used a noncentral catadioptric camera formed with a perspective camera and a spherical mirror. To test the proposed approach, we define a cube with texturized faces where each of the main steps of the framework is evaluated. To conclude, we used the proposed framework to project to the image the Stanford "bunny" object.

Application of AR virtual implantation technology based on deep learning and emotional technology in the creation of interactive picture books

“…At the same time, digital technology, as one of the emerging technologies, has also been developing rapidly, and this technology is especially reflected in the field of picture books, creating a new wave that has a profound impact on the way children read. Augmented reality (AR) is a common and popular over-the-top concept, the principle of which is to use computer technology to transfer virtual information into the real environment to achieve the combination of virtual and reality [4][5][6][7], in three-dimensional form, the application of AR technology to interactive picture books can improve children's extraction and recognition of information [8][9], allowing children to feel the overlap of virtual and real scenes to enhance the virtual emotional experience and provide a deeper understanding of knowledge. The application of deep learning and emotional technology will strengthen the emotional analysis in the creation of AR picture books and enrich the emotional education function of interactive picture books.…”