Since 1989, social change in Europe has moved between two stories. The first being a politics of memory emphasizing the specificity of culture in national narratives, and the other extolling the virtues of the Enlightenment heritage of reason and humanity. While the Holocaust forms a central part of West European collective memory, national victimhood of former Communist countries tends to occlude the centrality of the Holocaust. Highlighting examples from the Estonian experience, this article asks whether attempts to find one single European memory of trauma ignore the complexity of history and are thus potentially disrespectful to those who suffered under both Communism and National Socialism. Pluralism in the sense of Hannah Arendt and Isaiah Berlin is presented as a way in which to move beyond the settling of scores in the past and towards a respectful recognition and acknowledgement of historical difference.