VR technology, with its unique interactivity and immersive environment display, has a wide range of application prospects in various industries. In this paper, starting from the display and interaction experience of users for virtual environment design, we propose the optimization experience path of virtual environment user display and interaction and build up the optimization technology framework based on this. AutoCAD modeling software is used to complete three-dimensional modeling, and a three-dimensional display technology based on dual-computer communication is proposed to display the virtual environment in three dimensions. In the interaction design aspect, the virtual hand is optimized for detecting targets and generating grasping gestures. In the application of the optimization technology framework, the hotel apartment of Yuntianlou Intercontinental Plaza in Wenzhou City, Zhejiang Province, China, was selected as the design content for the virtual environment design. In the interactive performance evaluation, the average user rating of the virtual hand interaction method is 0.42 points higher than that of the traditional mouse interaction method, and the average computing time of the interaction is only about 60ms. In the comprehensive evaluation test, the average value of the environment display and interaction experience modules is more than 4 points, which indicates excellent display and interaction experiences.