Treatment for patients with locally advanced and recurrent rectal cancer differs significantly from patients with rectal cancer restricted to the mesorectum. Adequate preoperative imaging of the pelvis is therefore important to identify those patients who are candidates for multimodality treatment, including preoperative chemoradiation protocols, intraoperative radiotherapy, and extended surgical resections. Much effort should be made to select patients with these advanced tumors for treatment in specialized referral centers. This has been shown to reduce morbidity and mortality and improve long-term survival rates. In this article, we review the best treatment options for patients with locally advanced and recurrent rectal cancer. We also emphasize the necessity of a multidisciplinary team, including a radiologist, radiation oncologist, urologist, surgical oncologist, plastic surgeon, and gynecologist in the diagnosis and treatment of patients with these pelvic tumors.