Average pore pressure in oil formation is an important parameter to measure energy in the formation and the capacity of injection–production. In past studies, average pore pressure mainly depends on pressure build-up test results, which have a high cost and need a long testing time, so it is not conducive to utilize. In this paper, the vertical deformation of the Earth’s surface was used to calculate changes in reservoir pore pressure. We set up the marker stake for measuring ground displacement and measured the vertical deformation at the in situ position. Furthermore, we provided an improved new convolutional neural network (CNN), which adopted image-to-image mode, removed pooling layers and full connection layers, and used a new loss function considering the boundary influence coefficient matrix. Then, the machine learning method was used to invert surface vertical deformation to change pore pressure in the oil reservoir. The method was tested in the block of the Sazhong X development zone, in the Daqing Oilfield of China. The average pore-pressure change values of 20 grids whose area was 900×900 m each were determined by the inversion of the corresponding surface vertical deformation at 27 marker stakes. The pore pressure change accuracy reached 82.34%. This study provides a new method for calculating average pore pressure in terms of an oil block. At the same time, it also provides a new technical method for inversion calculations.