Still very little is known on the relaxation dynamics of glasses at the microscopic level due to the lack of experiments and theories. It is commonly believed that glasses are in a dynamical arrested state, with relaxation times too large to be observed on human time scales. Here we provide the experimental evidence that glasses display fast atomic rearrangements within a few minutes, even in the deep glassy state. Following the evolution of the structural relaxation in a sodium silicate glass, we find that this fast dynamics is accompanied by the absence of any detectable aging, suggesting a decoupling of the relaxation time and the viscosity in the glass. The relaxation time is strongly affected by the network structure with a marked increase at the mesoscopic scale associated with the ion-conducting pathways. Our results modify the conception of the glassy state and asks for a new microscopic theory.