Investigating the intra-ventricular flow is the most important to understand the left ventricular function. In this study, we proposed a fluid-structure interaction (FSI) approach to simulate the blood flow in patient-specific model by combining both mitral and aortic valves. To accommodate the large mesh deformation, moving arbitrary Lagrangian-Eulerian (ALE) meshes were used for moving ventricular wall and rotating leaflets of valves. The left ventricular wall was predescribed according to the points acquired from magnetic resonance image (MRI). Mitral and aortic valves were integrated into the model by assuming each leaflet as a rigid body. Fluid-structure interaction (FSI) approach was adopted to capture the rapid motion of leaflets. The simulation results were qualitatively similar to the measurements reported in literatures. To the best of our knowledge, this is the first to simulate the patient-specific ventricular flow with the presence of both mitral and aortic valves.