Historical records and genetic analyses indicate that Latin Americans trace their ancestry mainly to the admixture of Native Americans, Europeans and Sub-Saharan Africans1. Using novel haplotype-based methods here we infer the sub-populations involved in admixture for over 6,500 Latin Americans and evaluate the impact of sub-continental ancestry on the physical appearance of these individuals. We find that pre-Columbian Native genetic structure is mirrored in Latin Americans and that sources of non-Native ancestry, and admixture timings, match documented migratory flows. We also detect South/East Mediterranean ancestry across Latin America, probably stemming from the clandestine colonial migration of Christian converts of non-European origin (Conversos). Furthermore, we find that Central Andean ancestry impacts on variation of facial features in Latin Americans, particularly nose morphology, possibly relating to environmental adaptation during the evolution of Native Americans.