While recounting an experience, one could employ multiple strategies to transition from one part to the next. For instance, if the event was learned out of linear order, one could recall events according to the time they were learned (temporal), similar events (semantic), events occurring nearby in time (chronological), or events produced by the current event (causal). To disentangle the importance of these factors, we had participants watch the nonlinear narrative, “Memento,” under different task instructions and presentation orders. For each scene of the film, we also separately computed semantic and causal networks. From these derivations, we contrasted the evidence for temporal, semantic, chronological, or causal strategies during recall. Critically, there was stronger evidence for the causal and chronological strategies than semantic or temporal strategies. Moreover, the causal and chronological strategies outperformed the temporal one even after asking participants to recall the film in the presented order, underscoring the fundamental nature of causal structure in scaffolding understanding and organizing recall. Nevertheless, time still marginally predicted recall transitions, suggesting it still operates as a weak signal in the presence of more salient forms of structure. In addition, semantic and causal network properties predicted scene memorability, including showing a stronger role for causes of an event than its outgoing effects. In summary, these effects highlight the importance of accounting for complex, causal networks in knowledge building and memory.