The paper is devised to propose finite volume semi-Lagrange scheme for approximating linear and nonlinear hyperbolic conservation laws. Based on the idea of semi-Lagrangian scheme, we transform the integration of flux in time into the integration in space. Compared with the traditional semi-Lagrange scheme, the scheme devised here tries to directly evaluate the average fluxes along cell edges. It is this difference that makes the scheme in this paper simple to implement and easily extend to nonlinear cases. The procedure of evaluation of the average fluxes only depends on the high-order spatial interpolation. Hence the scheme can be implemented as long as the spatial interpolation is available, and no additional temporal discretization is needed. In this paper, the high-order spatial discretization is chosen to be the classical 5th-order weighted essentially non-oscillatory spatial interpolation. In the end, 1D and 2D numerical results show that this method is rather robust. In addition, to exhibit the numerical resolution and efficiency of the proposed scheme, the numerical solutions of the classical 5th-order WENO scheme combined with the 3rd-order Runge-Kutta temporal discretization (WENOJS) are chosen as the reference. We find that the scheme proposed in the paper generates comparable solutions with that of WENOJS, but with less CPU time.