Small variations introduced in shear flows are known to affect stability dramatically. Rotation of the flow system is one example, where the critical Reynolds number for exponential instabilities falls steeply with a small increase in rotation rate. We ask whether there is a fundamental reason for this sensitivity to rotation. We answer in the affirmative, showing that it is the non-normality of the stability operator in the absence of rotation which triggers this sensitivity. We treat the flow in the presence of rotation as a perturbation on the non-rotating case, and show that the rotating case is a special element of the pseudospectrum of the non-rotating case. Thus, while the non-rotating flow is always modally stable to streamwise-independent perturbations, rotating flows with the smallest rotation are unstable at zero streamwise wavenumber, with the spanwise wavenumbers close to that of disturbances with the highest transient growth in the non-rotating case. The instability critical rotation number scales inversely as the square of the Reynolds number, which we demonstrate is the same as the scaling obeyed by the minimum perturbation amplitude in non-rotating shear flow needed for the pseudospectrum to cross the neutral line. Plane Poiseuille flow and plane Couette flow are shown to behave similarly in this context.