The Use of Deep Learning and VR Technology in Film and Television Production From the Perspective of Audience Psychology

Abstract

As the development of artificial intelligence (AI) technology, the deep-learning (DL)-based Virtual Reality (VR) technology, and DL technology are applied in human-computer interaction (HCI), and their impacts on modern film and TV works production and audience psychology are analyzed. In film and TV production, audiences have a higher demand for the verisimilitude and immersion of the works, especially in film production. Based on this, a 2D image recognition system for human body motions and a 3D recognition system for human body motions based on the convolutional neural network (CNN) algorithm of DL are proposed, and an analysis framework is established. The proposed systems are simulated on practical and professional datasets, respectively. The results show that the algorithm's computing performance in 2D image recognition is 7–9 times higher than that of the Open Pose method. It runs at 44.3 ms in 3D motion recognition, significantly lower than the Open Pose method's 794.5 and 138.7 ms. Although the detection accuracy has dropped by 2.4%, it is more efficient and convenient without limitations of scenarios in practical applications. The AI-based VR and DL enriches and expands the role and application of computer graphics in film and TV production using HCI technology theoretically and practically.

Deep-Learning-Based Motion Capture Technology in Film and Television Animation Production

“…e transmitter is a fixed ultrasonic generator, and the receiver consists of 3 ultrasonic probes arranged in a triangular pattern [11,12]. is type of device is relatively low cost, but the capture of motion has a large delay and lag, real time is poor, the accuracy is generally not very high, and the sound source and the receiver cannot have large obscuring objects between, by noise and multiple reflections and other interference.…”

“…We use motion capture technology for film, television, and animation production, which can greatly improve the level of film, television, and animation production. It can greatly improve the efficiency of film and animation production, reduce the cost of film and animation production, and make the film and animation production process more intuitive and more vivid effects [11,[15][16][17].…”

“…e depth estimation of the targets is based on the 2D estimation of the joint point coordinates and the target detection with border regression. For each target segmented by the regression border, the pelvic key point P is selected as the human datum, and the target-to-camera distance (x p , y p , z p ) is calculated according to the imaging principle of the pinhole camera according to the method proposed in [11], where z p denotes the distance to the camera. Lacking support conditions for estimating the distance only from two-dimensional images, a new measurement scale was designed k as follows:…”

“…e realistic 3D motion of each person in the video is derived from a multiview masterless capture that can be adapted to both human-centered and camera-centered coordinate systems. MuCo-3DHP is another dataset for multiperson 3D estimation, which is derived by combining the MPI-INF-3DHP Evaluation protocols: there are two evaluation protocols that are widely used: the first one calculates the mean error of predicted pose and true pose joint point coordinates (MPJPE), and the second one is the mean error after alignment [11] and this mechanism is called PA MPJPE [27].…”

Examining the Influence of Using First-Person View Drones as Auxiliary Devices in Matte Painting Courses on College Students’ Continuous Learning Intention

“…The development of industry trends and the improvement of audience aesthetics have led to an increasing number of filmmakers using digital special effects in their films. Digital special effects help films tell stories more effectively through technology innovation ( Tong et al 2021 ). The visual effects have a significant influence on the viewers’ evaluation of the film.…”