Memory formation in the brain is thought to rely on the remodeling of synaptic connections which eventually results in neural network rewiring. This remodeling is likely to involve ultrathin astroglial protrusions which often occur in the immediate vicinity of excitatory synapses. The phenomenology, cellular mechanisms, and causal relationships of such astroglial restructuring remain, however, poorly understood. This is in large part because monitoring and probing of the underpinning molecular machinery on the scale of nanoscopic astroglial compartments remains a challenge. Here we briefly summarize the current knowledge regarding the cellular organisation of astroglia in the synaptic microenvironment and discuss molecular mechanisms potentially involved in use‐dependent astroglial morphogenesis. We also discuss recent observations concerning morphological astroglial plasticity, the respective monitoring methods, and some of the newly emerging techniques that might help with conceptual advances in the area. GLIA 2015;63:2133–2151