Recently, interest has surged in similarity-based epistemologies of possibility. However, it has been pointed out that the notion of ‘relevant similarity’ is not properly developed in this literature. In this paper, I look at the research done in the field of analogical reasoning, where we find that one of the most promising ways of capturing relevance in similarity reasoning is by relying on the predictive analogy similarity relation. This takes relevant similarity to be based on shared properties that have structural relations to the property of interest. I argue that if we base our epistemology of possibility on similarity reasoning on the predictive analogy similarity relation, we require prior knowledge of the specifics of these structural relations. I discuss a number of possible responses to this on behalf of the similarity theorists given their methodological approach to the epistemology of modality more generally. They could either opt for making explicit the metaphysics underlying these structural relations, in which case they need to spell out how we can come to know these relations. Or they could opt for developing a theory that explains why we do not need to have explicit knowledge of these structural relations; for example by suggesting that we make use of epistemic shortcuts.