All quantum systems are subject to noise and imperfections due to stray fields, inhomogeneities or drifting experimental controls. An understanding of the effects of noise and decoherence is critical to the progress towards fully functional quantum devices. In this perspective, we focus on noise in quantum systems which are modelled by a dynamic stochastic parameter in the Hamiltonian. We will outline exact evolution equations describing the ensemble average dynamics for a variety of common noise types and their connections. We will also highlight an approximate evolution equation valid in the weak noise limit for an arbitrary classical stochastic field. This framework should serve as a starting point for identifying signatures of differing noise types and optimisation of robust control protocols.