Selective relationships are fundamental to humans and many other animals, but relationships between mates, family members, or peers may be mediated differently. We examined connections between social reward and social selectivity, aggression, and oxytocin receptor signaling pathways in rodents that naturally form enduring, selective relationships with mates and peers (prairie voles) or peers (meadow voles). Female prairie and meadow voles worked harder to access familiar vs. unfamiliar individuals, regardless of sex, and huddled extensively with familiar subjects. Male prairie voles also displayed strongly selective huddling preferences for familiar animals, but worked hardest to repeatedly access females vs. males, with no difference in effort by familiarity. This demonstrates a fundamental disconnect between motivation and social selectivity in males, and reveals a striking sex difference in pathways underlying social monogamy. Meadow voles exhibited social preferences but low social motivation, consistent with tolerance rather than reward supporting social groups in this species. Natural variation in oxytocin receptor genotype was associated with oxytocin receptor density, and both genotype and receptor binding predicted individual variation in prosocial and aggressive behaviors. These results provide a basis for understanding species, sex, and individual differences in the mechanisms underlying the role of social reward in social preference.