The eye is an exemplarily challenging organ to treat when considering ocular tumors. It is at the crossroads of several major aims in oncology: tumor control, organ preservation, and functional outcomes including vision and quality of life. The proximity between the tumor and organs that are susceptible to radiation damage explain these challenges. Given a high enough dose of radiation, virtually any cancer will be destroyed with radiotherapy. Yet, the doses inevitably absorbed by normal tissues may lead to complications, the likelihood of which increases with the radiation dose and volume of normal tissues irradiated. Precision radiotherapy allows personalized decision-making algorithms based on patient and tumor characteristics by exploiting the full knowledge of the physics, radiobiology, and the modifications made to the radiotherapy equipment to adapt to the various ocular tumors. Anticipation of the spectrum and severity of radiation-induced complications is crucial to the decision of which technique to use for a given tumor. Radiation can damage the lacrimal gland, eyelashes/eyelids, cornea, lens, macula/retina, optic nerves and chiasma, each having specific dose–response characteristics. The present review is a report of non-cancer effects that may occur following ionizing irradiation involving the eye and orbit and their specific patterns of toxicity for a given radiotherapy modality.