The structure of the hydrated electron, particularly whether it exists primarily within a cavity or encompasses interior water molecules, has been the subject of much recent debate. In Paper I [C.-C. Zho et al., J. Chem. Phys. 147, 074503 (2017)], we found that mixed quantum/classical simulations with cavity and non-cavity pseudopotentials gave different predictions for the temperature dependence of the rate of the photoexcited hydrated electron's relaxation back to the ground state. In this paper, we measure the ultrafast transient absorption spectroscopy of the photoexcited hydrated electron as a function of temperature to confront the predictions of our simulations. The ultrafast spectroscopy clearly shows faster relaxation dynamics at higher temperatures. In particular, the transient absorption data show a clear excess bleach beyond that of the equilibrium hydrated electron's ground-state absorption that can only be explained by stimulated emission. This stimulated emission component, which is consistent with the experimentally known fluorescence spectrum of the hydrated electron, decreases in both amplitude and lifetime as the temperature is increased. We use a kinetic model to globally fit the temperature-dependent transient absorption data at multiple temperatures ranging from 0 to 45 C. We find the room-temperature lifetime of the excited-state hydrated electron to be 137±40 fs, in close agreement with recent time-resolved photoelectron spectroscopy (TRPES) experiments and in strong support of the "non-adiabatic" picture of the hydrated electron's excited-state relaxation. Moreover, we find that the excited-state lifetime is strongly temperature dependent, changing by slightly more than a factor of two over the 45C temperature range explored. This temperature dependence of the lifetime, along with a faster rate of ground-state cooling with increasing bulk temperature, should be directly observable by future TRPES experiments. Our data also suggest that the red side of the hydrated electron's fluorescence spectrum should significantly decrease with increasing temperature. Overall, our results are not consistent with the nearly complete lack of temperature dependence predicted by traditional cavity models of the hydrated electron but instead agree qualitatively and nearly quantitatively with the temperature-dependent structural changes predicted by the non-cavity hydrated electron model.