This article explores how two main narratives about slavery may lead to varying perspectives on social rights. Some collective narratives endorse a superficial idea of equality of rights, neglecting factors such as race and ethnicity, while others reject this apparent universalistic view, promoting more effective, de facto equality. The latter narrative supports horizontal redistribution, strongly contrasting with the former. Using Brazil’s affirmative action programs for Black students as a case study, this article will address two prevalent national narratives about the slavery of Black Africans and persons of Black African descent. Only one of those narratives could lead to what I would identify as a “contextualized theory of rights,” ensuring horizontal equality amidst a backdrop of brutal slavery and structural racism. This narrative offers a plurally faceted, dialogical approach to rights that can respond to the needs of differently situated individuals. The article will explore the evolution of such a collective narrative in Brazil’s race relations.