We report new microwave measurements of the anisotropic loss tangent and permittivity of rutile using well confined `whispering gallery' type modes of a shielded dielectric resonator. We report the first measurement of the two independent components of the loss tangent tensor, as well as the lowest measurement yet of the total loss tangent of parallel to the crystal c-axis and perpendicular to the c-axis, both measured at 3 K. We show that the mode frequency dependence possesses two stationary points in the temperature range 2-10 K and explain this dependence in terms of the competing effects of incidental paramagnetic impurities in the rutile, the variation of the rutile's permittivity with temperature and the thermal expansion of the material. We give the first measurements of the anisotropic permittivity of rutile at low temperatures.