Translation termination requires release factors that read a STOP codon in the decoding center and subsequently facilitate the hydrolysis of the nascent peptide chain from the peptidyl tRNA within the ribosome. In human mitochondria eleven open reading frames terminate in the standard UAA or UAG STOP codon, which can be recognized by mtRF1a, the proposed major mitochondrial release factor. However, two transcripts encoding for COX1 and ND6 terminate in the non-conventional AGA or AGG codon, respectively. How translation termination is achieved in these two cases is not known. We solve this long-standing open question by showing that the non-canonical release factor mtRF1 is a specialized release factor that triggers COX1 translation termination, while mtRF1a terminates the majority of other mitochondrial translation events including the non-canonical ND6. Loss of mtRF1 leads to isolated COX deficiency and activates the mitochondrial ribosome-associated quality control accompanied by the degradation of COX1 mRNA to prevent an overload of the ribosome rescue system. Taken together, these results establish the role of mtRF1 in mitochondrial translation, which had been a mystery for almost 25 years, and lead to a comprehensive picture of translation termination in human mitochondria.