Responsive nanomaterials that can undergo reversible changes in morphology are interesting for the development of functional materials that interact with and respond to their environment. Amphiphilic block copolymers are well known for their ability to create a wide range of supramolecular nanostructures in solution. Arylazopyrazoles (AAPs) are versatile molecular photoswitches, which change their configuration and hydrophobicity via irradiation with UV light (365 nm, Z isomer, less hydrophobic) and green light (520 nm, E isomer, more hydrophobic). In this work, photoswitchable block copolymers containing arylazopyrazole tetraethylene glycol methacrylate (AAPMA) and oligo(ethylene glycol) methacrylate (OEGMA) forming amphiphilic POEGMA b PAAPMA with varying block lengths are prepared by RAFT polymerization. The photochemical properties of AAP persist in the polymers. Due to their amphiphilic structure, the polymers self-assemble into supramolecular morphologies in water. Remarkably, photoisomerization results in a reversible change in the self-assembly behavior. Specifically, spherical and cylindrical micelles are observed for POEGMA33-b-PAAPMA47 when illuminated under green or UV light during assembly. Furthermore, the morphology of assembled structures can be reversibly switched by subsequent irradiation with UV and green light.