Social interactions have large effects on individual physiology and fitness. In the immediate sense, social stimuli are often highly salient and engaging. Over longer time scales, competitive interactions often lead to distinct social ranks and differences in physiology and behavior. Understanding how initial responses lead to longer-term effects of social interactions requires examining the changes in responses over time. Here we examined the effects of social interactions on transcriptomic signatures at two points, at the end of a 45-minute interaction and 4 hours later, in female P. fuscatus paper wasp foundresses. Female P. fuscatus have variable facial patterns that are used for visual individual recognition, so we separately examined the transcriptional dynamics in the optic lobe and the central brain. Results demonstrate much stronger transcriptional responses to social interactions in the central brain compared to the optic lobe. Differentially regulated genes in response to social interactions are enriched for memory-related transcripts. Comparisons between winners and losers of the encounters revealed similar overall transcriptional profiles at the end of an interaction, which significantly diverged over the course of 4 hours, with losers showing changes in expression levels of genes associated with aggression and reproduction in paper wasps. On nests, subordinate foundresses are less aggressive, do more foraging and lay fewer eggs compared to dominant foundresses and we find losers shift expression of many genes, including vitellogenin, related to aggression, worker behavior, and reproduction within hours of losing an encounter. These results highlight the early neurogenomic changes that likely contribute to behavioral and physiological effects of social status changes in a social insect.