We report the genetic structure and evolutionary relationship of the endangered Toda buffalo of Nilgiris in South India with Kanarese and two other riverine buffalo breeds. The upgma phylogeny drawn using Nei's distance grouped South Kanara and Toda buffaloes at a single node while Marathwada and Murrah together formed a separate node. Principal component analysis was performed with pairwise interindividual chord distances which revealed clustering of Murrah and Marathwada buffaloes distinctly, while individuals of Toda and South Kanara breeds completely intermingled with each other. Furthermore, there were highly significant group variances (p < 0.01) when the breeds were grouped based on phylogeny, thus revealing the existence of cryptic genetic structure within these buffalo breeds. To know the evolutionary relationship among these breeds, 537-bp D-loop region of mitochondrial DNA was analysed. The phylogenetic analysis of mtDNA haplotypes following NJ algorithm with Chinese swamp buffalo as outgroup revealed a major cluster that included haplotypes from all the four investigated breeds and two minor clusters formed by South Kanara and Toda haplotypes. Reduced median network analysis revealed haplotypes of South Kanara and Toda to be quite distinct from the commonly found haplotypes indicating that these might have been ancestral to all the present-day haplotypes. Few mutations in two of the haplotypes of South Kanara buffalo were found to have contributed to ancestral haplotypes of Toda buffalo suggesting the possible migration of buffaloes from Kanarese region towards Nilgiris along the Western Ghats. Considering the close social, economic and cultural association of Todas with their buffaloes, the present study supports the theory of migration of Toda tribe from Kanarese/Mysore region along with their buffaloes.