Sustainable development requires a shift from traditionally invested assets to socially responsible investing (SRI), bringing together financial profits and social welfare. Private high-net-worth individuals (HNWIs) are critical for this shift as they control nearly half of global wealth. While we know little about HNWIs’ investment behavior, reference group theory suggests that their SRI engagement is influenced by their identification with and comparison to reference groups. We thus ask: how do reference groups influence the investment behavior of SRI-oriented HNWIs? To answer this question, we analyzed a unique qualitative data set of 55 semi-structured interviews with SRI-oriented HNWIs and industry experts. Our qualitative research found that, on the one hand, the family serves as a normative reference group that upholds the economic profit motive and directly shapes HNWIs to make financial gains from their investments at the expense of social welfare. On the other hand, fellow SRI-oriented HNWIs serve as a comparative reference group that does not impose any concrete requirements on social welfare performance, indirectly influencing SRI-oriented HNWIs to subordinate social concerns to financial profits. Our scholarly insights contribute to the SRI literature, reference group theory, and practice.