Critical race theory holds that racism, and by extension othering, is embedded within every aspect of American society. We agree with critical race theorists, but elaborate further, that othering in some form or another, has existed since the Stone Age, and evolves with the uneven expansion of social complexity and the emergence of hierarchies. Othering, has always been important for reproducing differences and inequalities within society. We highlight the socially “distant other” to instruct the ways we discern modern racism, and how it has evolved from its past iterations. The argument we hope to convey is that at its core, distant othering involves the fear of a perceived threat to the existing social order and with the emergence of global capitalism, the racialized version of othering is violent, a violence that that becomes particularly intense when rates of profit collapse (i.e. economic crises) and/or when group-statuses are threatened. The theoretical perspective we use is institutional materialism and we take a historical, long-term sociocultural evolution approach. We detail othering in the Stone Age, which centers around kinship distance, the transition from small scale societies to the Bronze Age, as well as othering in the Axial Age and the modern era. The modern version of othering, which centers on nationality, race and ethnicity, is coupled with global capitalism and plays out in particularly cruel ways.