This article explored the effect of physical activity time and that of the heart rate during physical activity on mental fatigue intervention. First, we acquired electrocardiogram from 104 subjects, calculated the inter-beat intervals (IBI), removed the abnormal values in the IBI series, segmented and divided the IBI series into training and validation datasets and application datasets according to the inclusion criteria of mental fatigued and non-fatigued states. Second, we extracted 39 linear and non-linear RR parameters as fatigue physiological features, and applied Leave-One-Subject-Out cross test and Sequential Backward Selection algorithm for feature selection while training some traditional classifiers. Third, we applied the best trained classifier to detect mental fatigue before and after physical activity. Finally, we analyzed the change of mental fatigue status before and after physical activity and obtained the following three findings: (1) physical activity did not have intervention effect on mental fatigue for 62% observed cases; (2) for 38% observed cases, physical activity could aggravate or relieve mental fatigue; (3) for the observed cases that the physical activity time was in the range of 5-15 minutes, the average heart rate in 100-140 beat per minute during physical activity was more likely to relieve mental fatigue