The Genographic Consortium 3 Y-chromosome Haplogroup O is the dominant lineage of East Asians, comprising more than a quarter of all males on the world; however, its internal phylogeny remains insufficiently investigated. In this study, we determined the phylogenetic position of recently defined markers (L127, KL1, KL2, P164, and PK4) in the background of Haplogroup O. In the revised tree, subgroup O3a-M324 is divided into two main subclades, O3a1-L127 and O3a2-P201, covering about 20 and 35% of Han Chinese people, respectively. The marker P164 is corrected from a downstream site of M7 to upstream of M134 and parallel to M7 and M159. The marker PK4 is also relocated from downstream of M88 to upstream of M95, separating the former O2* into two parts. This revision evidently improved the resolving power of Y-chromosome phylogeny in East Asia.