Background and Objectives: Subjective visual function is currently becoming an increasing appreciation in assessing the health-related quality of life. This study aimed to assess the vision-related quality of life (VRQOL) among patients with refractive errors, keratoconus, senile cataract, and age-related macular degeneration (AMD) using the Chinese version of the National Eye Institute Visual Function Questionnaire 25 (NEI-VFQ-25). Materials and Methods: The questionnaire of NEI-VFQ-25 was filled out in a clinical setting or by telephone/mail. Univariate and multivariate analyses were used to determine which factors are associated with the NEI-VFQ-25. Results: From June 2018 to January 2019, 28 patients with refractive error, 20 patients with keratoconus, 61 with senile cataracts, and 17 with AMD completed the questionnaire NEI-VFQ-25. There were significant differences in the NEI-VFQ-25 subscale of general vision (p = 0.0017), ocular pain (p = 0.0156), near activities (p = 0.0002), vision-specific social functioning (p = 0.007), vision-specific mental health (p = 0.0083), vision-specific dependency (p = 0.0049), color vision (p < 0.0001), peripheral vision (p = 0.0065), and total score (p < 0.0001) among four disease groups, respectively. The multiple linear regression revealed that the best-corrected visual acuity (BCVA) and disease group were important factors of the total NEI-VFQ-25. After adjusting for BCVA, patients with AMD had a worse total NEI-VFQ-25 score than patients with refractive error, keratoconus, or senile cataracts. Conclusions: Among the patients with four ocular disorders and a broad vision spectrum from normal, partial sight, low vision to legal blindness, the BCVA of their better eye was the most important factor in the VRQOL.