Inferences are ubiquitous during linguistic communication and characterize diverse phenomena. In a large-scale individual-differences investigation, we asked whether pragmatic ability—the ability to go beyond literal meaning—is monolithic or whether it consists of at least partially dissociable cognitive skills. In Experiment 1, n=376 participants each completed an 8-hour behavioral battery of 18 pragmatic tasks in English. Controlling for IQ, an exploratory factor analysis revealed three clusters corresponding to i) the ability to adhere to social conventions (including phenomena like indirect requests and irony), ii) the ability to interpret emotional and contrastive intonation patterns, and iii) the ability to make causal inferences based on world knowledge. This pattern largely replicated in a new sample of n=400 participants (Experiment 2). This research uncovers important dissociations in the cognitive toolkit underlying human communication and can inform our understanding of pragmatic abilities in individuals with developmental and acquired brain disorders.