This paper proposes a video architecture and real-time lighting technology for tangible teleconference. The tangible teleconference is to homogenize virtually the lighting environments of remote users in the video conference. To realize the tangible teleconference, the paper proposes a video architecture which consists of color texture, specular reflection component, and lighting environment map of each user. The environment map is obtained by sampling the lighting sources on mirror ball image. And the proposed video architecture is implemented by GPU-based programming, and is optimized at GPU hardware for realtime operation. According to the simulations, the proposed video architecture and GPU-based rendering relight objects in real-time. The objects are rendered by the specular reflections and homogeneous environments of users. The proposed system enables the users to immerse video conference just as they are in the same environment.
This paper deals with a real-time image based relighting system for tangible video teleconference. The proposed image based relighting system renders the extracted human object using the virtual environmental images. The proposed system can homogenize virtually the lighting environments of remote users on the video teleconference, or render the humans like they are in the virtual places. To realize the video teleconference, the paper obtains the 3D object models of users in real-time using the controlled lighting system. In this paper, we use single color camera and synchronized two directional flash lights. Proposed system generates pure shading images using on and off flash images subtraction. One pure shading reflectance map generates a directional normal map from multiplication of each reflectance map and basic normal vector map. Each directional basic normal map is generated by inner vector calculation of incident light vector and camera viewing vector. And the basic normal vector means a basis component of real surface normal vector. The proposed system enables the users to immerse video teleconference just as they are in the virtual environments.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.