The stream of affect is the result of a constant interaction between past experiences, motivations, expectations and the unfolding of events. How the brain represents the relationship between time and affect has been hardly explored, as it requires modeling the complexity of everyday life in the laboratory. Movies condense into hours a multitude of emotional responses, synchronized across subjects and characterized by temporal dynamics alike real-world experiences.Here, using naturalistic stimulation, time-varying intersubject brain connectivity and behavioral reports, we demonstrate that connectivity strength of large-scale brain networks tracks changes in affect. The default mode network represents the pleasantness of the experience, whereas attention and control networks encode its intensity. Interestingly, these orthogonal descriptions of affect converge in right temporoparietal and fronto-polar cortex. Within these regions, the stream of affect is represented at multiple timescales by chronotopic maps, where connectivity of adjacent areas preferentially maps experiences in 3-to 11-minute segments.--- Figure 3 about here ---