There are conflicting results regarding the effect of aging on second-order motion processing (i.e., motion defined by attributes other than luminance, such as contrast). Two studies (Habak and Faubert, 2000; Tang and Zhou, 2009) found that second-order motion processing was more vulnerable to aging than first-order motion processing. Conversely, Billino et al. (2011) recently found that aging affected first- and second-order motion processing by similar proportions. These three studies used contrast-defined motion as a second-order stimulus, but there can be at least two potential issues when using such a stimulus to evaluate age-related sensitivity losses. First, it has been shown that the motion system processing contrast-defined motion varies depending on the stimulus parameters. Thus, although all these three studies assumed that their contrast-defined motion was processed by a low-level second-order motion system, this was not necessarily the case. The second potential issue is that contrast-defined motion consists in a contrast modulation of a texture rich in high spatial frequencies and aging mainly affects contrast sensitivity at high spatial frequencies. Consequently, some age-related sensitivity loss to second-order motion could be due to a lower sensitivity to the texture rather than to motion processing per se. To avoid these two potential issues, we used a second-order motion stimulus void of high spatial frequencies and which has been shown to be processed by a high-level feature tracking motion system, namely fractal rotation (Lagacé-Nadon et al., 2009). We found an age-related deficit on second-order motion processing at all temporal frequencies including the ones for which no age-related effect on first-order motion processing was observed. We conclude that aging affects the ability to track features. Previous age-related results on second-order and global motion processing are discussed in light of these findings.