Background: Recent studies show that substantial percentage of patients experienced worsening of health related quality of life (HRQoL) 1 year after cardiac surgery. The aim of this study is to identify risk factors that interfere with improvement of HRQoL. Methods: From December 2015 till July 2017 a prospective single centre observational study was carried out in 1920 patients participated who underwent non-salvage cardiac surgery. All patients were requested to complete a Short Form 36 (SF-36) questionnaire before and 1 year after surgery. Primary aim of the study was to identify risk factors for non-recovery in the physical domain of the SF-36 in all cardiac surgery patients. Secondary aim was to identify identical risk factors in patients with isolated coronary artery bypass grafting. Results: After cardiac surgery, the questionnaires for physical and mental health were completed by respectively 803 and 807 patients. Median age was 69[62-75] years, and 77% was male. In comparison to the preoperative status, 176 patients (21.9%) did not display an improvement in the SF-36 physical domain score 1 year after cardiac surgery. In a multivariate analysis independent risk factors for non-recovery in the SF-36 physical domain were baseline SF36 physical domain score (OR 0.954[0.942-0.965], P < 0.001), diabetes (OR 0.437 [0.265-0.720], P 0.001), female sex (OR 0.492 [0.307-0.789], P 0.003), post-operative infection (OR 0.240 [0.109-0.525], P < 0.001) and PCI within 1 year (OR 0.113 [0.036-0.349], P < 0.001) For isolated CABG, 23.2% of patients did not display an improvement in the physical domain score and risk factors appeared to be identical. Conclusions: Twenty two percent of all cardiac surgery patients did not show an improvement in the physical domain score of the HRQoL between the preoperative period and 1 year after surgery. Independent risk factors for non-recovery after cardiac surgery were baseline SF-36 physical domain score, diabetes, female sex, any postoperative infection and the need for PCI in the first year. Further research is needed to tailor the patient selection procedure prior to surgery and potentially modify risk factors in the perioperative process.