Could there be intermediate mass black holes in essentially all old dwarf galaxies? I argue that current observations of Active Galactic Nuclei in dwarfs allow such a radical hypothesis which provides early feedback and potentially provides a unifying explanation for many if not all of the apparent dwarf galaxy anomalies, such as the abundance, core-cusp, "too big to fail", ultra-faint and baryon-fraction issues. I describe the supporting arguments, which are largely circumstantial in nature, and discuss a number of tests. There is no strong motivation for modifying the nature of cold dark matter in order to explain any of the dwarf galaxy "problems".