With the development of medical multimedia analysis methods based on DBN, DBN models have gained the ability to surpass medical experts in the evaluation of multimedia in some clinical examinations. Firstly, based on the existing architecture of the Internet of Things, combined with the actual characteristics of the hospital, the medical multimedia data is accessed from the IoT support platform. Secondly, the medical multimedia data modeling and classification method based on DBN is studied and analyzed. Three network structure models, a deep belief network, a stacking automatic encoder and a convolutional neural network, were introduced and analyzed. The medical multimedia data classification modeling method based on DBN was proposed to further improve the accuracy of medical multimedia data classification. The experimental results show that compared with the traditional feature extraction based neural network classification method, the classification performance is better. Thirdly, the medical state assessment model is constructed based on the multivariate Gaussian distribution theory. To study how to use the multivariate Gaussian distribution theory to design an evaluation model that can evaluate the health status of users efficiently and accurately. Finally, using the MATLAB software platform, through the experiment and simulation of 40 groups of 8×8064-dimensional physiological big data of 32 volunteers, First, determine the optimal parameters of a set of health assessment models; then use the model to learn the characteristics of physiological parameters; finally, the state assessment model to obtain the health assessment results. The experimental results show that the feature learning model based on convolutional neural network theory can effectively extract the deep features of medical multimedia big data. The health state assessment model based on multivariate Gaussian distribution theory can effectively evaluate the health status of human body. INDEX TERMS DBN, medical multimedia, neural network, feature extraction, multivariate Gaussian distribution.