Aiming at the problems of lateral force interference and non-uniform strain of robot fingers in the process of pressure tactile sensing, a flexible tactile sensor with a square hole structure based on fiber Bragg grating (FBG) is proposed in this paper. Firstly, the optimal embedding depth of the FBG in the sensor matrix model was determined by finite element simulation. Secondly, according to the size of the finger knuckle and the simulation analysis based on the pressure tactile sensor element for the robot finger, the square hole structure was designed, and the overall dimensions of the sensing element and size of the square hole were determined. Thirdly, the FBG was embedded in the polydimethylsiloxane (PDMS) elastic matrix to make a sensor model, and the tactile sensor was fabricated. Finally, the FBG pressure tactile sensing system platform was built by using optical fiber sensing technology, and the experiment of the FBG tactile sensor was completed through the sensing system platform. Experimental results show that the tactile sensor designed in this paper has good repeatability and creep resistance. The sensitivity is 8.85 pm/N, and the resolution is 0.2 N. The loading sensitivity based on the robot finger is 27.3 pm/N, the goodness of fit is 0.996, and the average value of interference in the sensing process is 7.63%, which is lower than the solid structure sensor. These results verify that the sensor can effectively reduce the lateral force interference and solve the problem of non-uniform strain and has high fit with fingers, which has a certain application value for the research of robot pressure tactile intelligent perception.