Relaxation of shear bands in a Pd 40 Ni 40 P 20 bulk metallic glass was investigated by a combination of radiotracer diffusion and molecular dynamics (MD) simulations, allowing to determine for the first time the effective activation enthalpy of diffusion along shear bands in a deformed glass. The shear bands relax during annealing below the glass transition temperature and the diffusion enhancement reveals unexpectedly a nonmonotonous behavior. The development of shear bands and the subsequent relaxation of stresses after switching off the shearing are characterized on microscopic to mesoscopic length scales by MD simulation subjecting the model glass to a constant strain rate. Mean-squared displacements as well as strain maps indicate that the heterogeneity, as manifested by shear bands in the systems under shear, persist after the shear is switched off. We observe a further relaxation of residual stresses that remain localized in regions where the shear band has been present before, although the system is -different from the macroscopic experiment -homogeneous with respect to the local density. These results indicate that even on a local scale one may expect strong dynamic heterogeneity in deformed glassy solids due to shear banding. The results thus suggest that plastically deformed metallic glasses present poly-amorphous systems that necessitate descriptions that are analogous to multiphase materials including the presence of heterophase interfaces.Although non-homogenous plastic deformation of bulk metallic glasses (BMGs) via the formation of shear bands attracted increased attention in the past [1,2], it is still far from being resolved, see e.g. the reviews in [3,4]. As a generally accepted concept, so-called "shear transformation zones" (STZ), i.e. areas in which groups of atoms collectively undergo a local shear transformation, have been introduced [5] as "unit carriers" of plastic deformation in metallic glasses. A cross-over from random 3-dimensional shear events (STZ formation) to correlated 2-dimensional dynamics has been brought forward to explain the observed shear banding in metallic glasses [6]. Although the activation of a single STZ event is not inevitably related to a change of the excess volume, shear bands are often described in terms of excess volume accumulation [3,7]. Recently, we investigated diffusion in deformed Pd 40 Ni 40 P 20 (at. %; in what follows we will use the abbreviation PdNiP) glass, in which almost a single family of shear bands was introduced, and were able to unambiguously prescribe the observed enormous enhancement of the diffusion rate to an ultra-fast atomic transport along these quasi-2-dimensional pathways [8]. The tracer concentrations in the corresponding concentration profiles, which were related to shear band diffusion, were shown to scale with the number density of the introduced shear bands (that in turn scales with the imposed strain),