To investigate the prognostic factors of extraocular muscle restriction in patients with thyroid eye disease (TED), 65 patients with TED and restrictive myopathy were evaluated. Demographics, clinical activity score (CAS), smoking status, thyroid disease status, thyroid hormone status, thyroid autoantibody status, orbital computed tomography (CT) scan at initial presentation, and treatment regimens were assessed. The movements of the most severely affected extraocular muscles were categorized into five grades. The patients were divided into the improved and the not-improved group based on the improvement in the limitation of the extraocular muscle excursion (LOM) throughout the follow-up, and the groups were compared using clinical factors. The mean LOM significantly improved from 2.3 ± 1.1 to 1.7 ± 1.2 after 1 year of follow-up. The excursion of the most restricted muscle improved in 32 patients but not in 33 patients during the follow-up. The initial concentration of the thyroid-stimulating antibody (TSAb) was significantly lower in the improved (229.3 ± 114.1) than in the not-improved group (345.0 ± 178.6) (P = 0.02) Age, sex, smoking status, CAS, thyroid status, and muscle thickness on the CT scan did not significantly differ in the groups. This study showed that the initial concentration of TSAb is a factor affecting the recovery of restrictive myopathy.