Nanoparticles significantly reinforce rubbers, but their influence on polymer dynamics is far from being understood. Here a comparison study of polymer dynamics in silica‐filled nitrile butadiene rubber compounds and their bound rubber in extracted filler gels is performed. Both the compounds and filler gels contain glassy, restricted, and mobile rubber fractions. The restricted fraction detected by broadband dielectric spectra exhibits a subsegmental relaxation that is two to four orders of magnitude slower than the segmental dynamics of the mobile phase. It is significant that the extractable fraction interacts with both the restricted and mobile fractions in the bound rubber, thus improving the activation energy of restricted relaxation and reducing the fragility of segmental relaxation in the mobile fractions. Meanwhile, the influences of loading, surface nature, and specific surface area of the silica on the dynamics heterogeneity are investigated. © 2018 Wiley Periodicals, Inc. J. Appl. Polym. Sci. 2018, 135, 46223.