Adult visual plasticity underlying local remodeling of the cortical circuitry in vivo appears to be associated with a spatiotemporal pattern of strongly increased spontaneous and evoked activity of populations of cells. Here we review and discuss pioneering work by us and others about principles of plasticity in the adult visual cortex, starting with our study which showed that a confined lesion in the cat retina causes increased excitability in the affected region in the primary visual cortex accompanied by fine-tuned restructuring of neuronal function. The underlying remodeling processes was further visualized with voltage-sensitive dye (VSD) imaging that allowed a direct tracking of retinal lesion-induced reorganization across horizontal cortical circuitries. Nowadays, application of noninvasive stimulation methods pursues the idea further of increased cortical excitability along with decreased inhibition as key factors for the induction of adult cortical plasticity. We used high-frequency transcranial magnetic stimulation (TMS), for the first time in combination with VSD optical imaging, and provided evidence that TMS-amplified excitability across large pools of neurons forms the basis for noninvasively targeting reorganization of orientation maps in the visual cortex. Our review has been compiled on the basis of these four own studies, which we discuss in the context of historical developments in the field of visual cortical plasticity and the current state of the literature. Overall, we suggest markers of LTP-like cortical changes at mesoscopic population level as a main driving force for the induction of visual plasticity in the adult. Elevations in excitability that predispose towards cortical plasticity are most likely a common property of all cortical modalities. Thus, interventions that increase cortical excitability are a promising starting point to drive perceptual and potentially motor learning in therapeutic applications.