Nuclear medicine utilizes ionizing radiation for both in vivo diagnosis and therapy. Ionizing radiation comes from a variety of sources, including X-rays, beam therapy, brachytherapy, and various injected radionuclides. While positron emission tomography and single-photon emission computed tomography remain clinical mainstays, optical readouts of ionizing radiation offer numerous benefits and complement these standard techniques. Furthermore, for ionizing radiation sources that cannot be imaged using these standard techniques, optical imaging offers a unique imaging alternative. This article reviews optical imaging of both radionuclide- and beam-based ionizing radiation from high-energy photons and charged particles through mechanisms including radioluminescence, Cerenkov luminescence, and scintillation. Therapeutically, these visible photons have been combined with photodynamic therapeutic agents pre-clinically for increasing therapeutic response at depths difficult to reach with external light sources. Lastly, new microscopy methods that allow single cell optical imaging of radionuclides are reviewed.