In natural settings the same sound source is often heard repeatedly, with variations of the spectro-temporal and spatial characteristics. We have investigated how such repetitions influence sound representations and in particular how the auditory cortex keeps track of recently vs often heard objects. A set of 40 environmental sounds was presented twice, i.e. as prime and as repeat, within each of 16 experimental blocks, while subjects categorized the corresponding sound sources as living vs non-living. Electrical neuroimaging analyses were applied to auditory evoked potentials (AEPs) comparing primes vs repeats (effect of presentation) and the four sections (à 4 blocks each; effect of section). Dynamic analysis of distributed source estimations revealed i) one cluster within the left temporal convexity showing a significant main effect of presentation at 164-215ms post-stimulus onset; and ii) a cluster of significant main effect of section, in the right temporo-parietal junction at 166-213ms. Thus, spatio-temporal dynamics of neural activity encode the temporal history of exposure to sound objects. Rapidly occurring plastic changes within the semantic representations of the left hemisphere keep track of objects heard a few seconds before, independently of the more general sound exposure history. Progressively occurring and more long-lasting plastic changes within networks coding for perceptual, semantic and spatial aspects of sound objects within the right hemisphere keep track of multiple exposures.