Given the small sample size, nonlinearity, and large dispersion of the measured data of fatigue performance for vibration isolation rubbers, the fatigue life prediction model for vibration isolation rubber materials was established using a support vector machine (SVM). A modified gravity search algorithm (MGSA) is proposed to optimize the parameters of the SVM. Using environmental temperature, the Rockwell hardness of the rubber compound, and the engineering strain peak as the input variables, the model was trained based on the experimental fatigue data of vibration isolation rubber materials. For comparison, the standard genetic algorithm, the standard particle swarm algorithm, and the standard simulated annealing algorithm are also implemented. Moreover, a back propagation neural network regression model is applied to the life prediction, with the conclusion that the prediction accuracy and the efficiency of MGSA are better than those of extant methods. This work can provide reference for further fatigue life prediction and structural improvement of rubber parts.