As a metaphysical theory, radical ontic structural realism (ROSR) is characterised mainly in terms of the ontological primacy it places on relations and structures, as opposed to the individual relata and objects that inhabit these relations/structures. The most popular criticism of ROSR is that its central thesis (that there can exist 'relations without relata') is incoherent. Bain (Synthese, 190, 1621(Synthese, 190, -1635(Synthese, 190, , 2013 attempts to address this criticism by arguing that the mathematical language of category theory allows for a coherent articulation of ROSR's key thesis. Subsequently, Wüthrich and Lam (2014) and Lal and Teh (2015) have criticised Bain's arguments and claimed that category theory fares no better than set theory in coherently articulating the main ideas of ROSR. In this paper, we defend Bain's main arguments against these critiques, and attempt to elaborate on the sense in which category theory can be seen as providing a coherent articulation of ROSR. We also consider the relationship between ROSR and Categorical Quantum Mechanics.