Photoresponsive polymers have become one of the most important smart materials due to their unique advantages such as excellent sensitivity, high contrast, and rapid response. Endowing photoresponsive polymers with aggregation-induced emission (AIE) can not only enrich the research of materials science but also expand the applications of smart materials. Photoresponsive AIE polymers are generally constructed by combining AIE luminogens (AIEgens) with photoresponsive units via chemical, supramolecular, or physical strategies. In terms of the working mechanisms, two main responsive systems, namely, photochemical and photophysical, are summarized with specific application examples. Photoresponsive AIE polymers have been applied not only in chemosensors, photopatterning, and photodegradable materials but also in biosystems for photodynamic therapy, photothermal therapy, photoacoustic imaging, and photobiosynthesis. This Review concludes with a discussion on the challenges and perspectives for future directions in this field. All the achievements and advantages mentioned in this Review indicate the fascinating properties and bright future of photoresponsive AIE polymers.