Objectives: Medications with anticholinergic or sedative effects induce impaired cognitive and physical performances. The aim of this study was to evaluate the associations of anticholinergic and sedative drug burden with recovery of physical function and activities of daily living in patients admitted to a Japanese rehabilitation hospital after cerebrovascular accidents. Methods: We retrospectively reviewed the medical records of patients aged 18 years or older who had undergone the inpatient rehabilitation program for cerebrovascular disease in Nerima Ken-ikukai Hospital. Patients who did not complete the rehabilitation program because of acute unexpected changes of physical or psychological condition or the need for surgical procedures were excluded. The primary outcome was recovery of activities of daily living as measured by the motor and cognitive subscores of the Functional Independence Measure. The secondary outcome was recovery of physical function as assessed by the 10-m walk test and the Berg balance scale. Multiple Cox proportional hazard regression analyses were conducted to calculate hazard ratios with 95% confidence intervals for the outcome measures. Results: Of 122 patients included in the study, 81 (66%) were exposed to anticholinergics and sedatives. Patients’ age, body mass index, and average daily drug burden during hospitalization were independently associated with achieving the cutoff Functional Independence Measure–motor subscore. Patients’ age and average daily drug burden during hospitalization were independently associated with achieving the Berg balance scale cut-off score. Conclusions: Our study of Japanese patients who were transferred from acute stroke care hospitals to a rehabilitation facility identified the drug burden of anticholinergics and sedatives as an independent factor associated with the time to recovery of activities of daily living and postural balance.