Sarcopenia, defined as a progressive loss of muscle mass and function, is typified by mitochondrial dysfunction and loss of mitochondrial resilience. Sarcopenia is associated not only with aging, but also with various metabolic diseases characterized by mitochondrial dyshomeostasis. Pyruvate dehydrogenase kinases (PDKs) are mitochondrial enzymes that inhibit the pyruvate dehydrogenase complex, which controls pyruvate entry into the tricarboxylic acid cycle and the subsequent adenosine triphosphate production required for normal cellular activities. PDK4 is upregulated in mitochondrial dysfunction-related metabolic diseases, especially pathologic muscle conditions associated with enhanced muscle proteolysis and aberrant myogenesis. Increases in PDK4 are associated with perturbation of mitochondria-associated membranes and mitochondrial quality control, which are emerging as a central mechanism in the pathogenesis of metabolic disease-associated muscle atrophy. Here, we review how mitochondrial dysfunction affects sarcopenia, focusing on the role of PDK4 in mitochondrial homeostasis. We discuss the molecular mechanisms underlying the effects of PDK4 on mitochondrial dysfunction in sarcopenia and show that targeting mitochondria could be a therapeutic target for treating sarcopenia.