Using the unity® game engine as a platform for advanced real time cinema image processing

A Game Engine as a Generic Platform for Real-Time Previz-on-Set in Cinema Visual Effects

“…Re-projection of the low resolution depth map becomes a dense interpolation, fitting the resolution of the film camera. More details are presented in [5]. Note that shaders may also be used for many kernel-based image filtering.…”

“…The novelty and originality of the proposed work is that we show that using a game engine is also efficient for the following aspects: (1) managing physical interactions between real and virtual worlds, (2) coupling our previous system with a camera tracking system, (3) re-using all the information captured in real-time in post-production, (4) improving the realism of the virtual assets with the real scene lighting. At last, the results presented here are also more numerous than in [5]. This paper is outlined as follows: in section 2 we present some technical background features that are the bases of our solution and we compare them with relative works on this field.…”

“…Apart from a first use of Unity R in previz [18] but only for the visualisation of special effects, to our best knowledge our work is the first one to use a game engine in the particular field of previz and more generally in the mix of virtual and real worlds. In [5], we presented a preliminary version of this work. The novelty and originality of the proposed work is that we show that using a game engine is also efficient for the following aspects: (1) managing physical interactions between real and virtual worlds, (2) coupling our previous system with a camera tracking system, (3) re-using all the information captured in real-time in post-production, (4) improving the realism of the virtual assets with the real scene lighting.…”