Background: Music therapy (MT) may exert beneficial preventive effects in frail elderly individuals in psychophysiological health. Objectives: One hundred and fifteen frail elderly individuals (65–89 years old) participated. Methods: Subjects were randomly divided into 2 groups for a controlled crossover trial. The MT-first group participated in group sessions of 45–50 min conducted by a certified music therapist for 12 weeks, followed by a 12-week waiting period. The waiting-first group participated in the reverse order. Cognitive function was assessed by the Verbal Fluency Test (VFT) and Yamaguchi Kanji Symbol Substitution Test (YKSST). Physical function was assessed by the Timed Up and Go test (TUG). Psychophysical health was assessed by the Geriatric Depression Scale 15-item version (GDS-15), General Health Questionnaire 12-item version (GHQ-12), Instrumental Activity of Daily Living (IADL) scale, and Life Space Assessment (LSA) scale. We also evaluated the outcome of MT using the Clinical Global Impressions of Improvement (CGI-I) scale. Results: After 12 weeks of MT, significant improvements were observed in TUG, GDS-15, and GHQ-12 scores. However, no improvements were noted in other scores. CGI-I scores revealed the significant benefits of MT. Conclusions: MT may improve physical function, depressive mood, and quality of life in frail elderly individuals.