In his last writings, Wittgenstein repeatedly addresses the question of how our concepts relate to general facts of nature or human nature and how they are embedded in our lives. In doing so, he uses the term “pattern of life”, characterizing the complicated relationship between concepts and our lives and how our concepts “are connected with what interests us, with what matters to us” (LWPP II, 46). But who is this “us”, and whose interests manifest in the concepts we use to designate patterns of life? What if certain concepts—or their absence—are exclusionary, discriminatory, or otherwise unjust to those who are not “us”? In this paper, I want to discuss Wittgenstein’s notion of “pattern of life” in its interweaving with facts, human life, and concepts, as well as its political implications. To this end, I will first outline the relationship between facts and concept formation as Wittgenstein drew it in his last writings. Based on this, I will argue that he uses the concept of pattern of life to capture the complicated relationship between concepts and human nature or “social facts”. Going beyond Wittgenstein and drawing on recent feminist epistemology, I will raise the question of the political implications of our patterns of life and concomitant social “conceptual injustices”. Finally, I will show how imagining facts otherwise and other conceptual worlds can help us to reveal the prejudices and injustices of our concepts and can lead to conceptual change and new patterns of life that may ultimately even change “things”, i.e., our thinking, judging and acting in the world.