Heart failure has been divided into heart failure with preserved left ventricular (LV) ejection fraction (EF) and heart failure with reduced EF, because the pathophysiologies of the two conditions are different. Cardio-ankle vascular index (CAVI) is a new indicator of arterial stiffness, and the most conspicuous feature of CAVI is its independence of blood pressure at the time of measurement. Arterial stiffness has been considered to increase LV afterload, which requires special care to avoid the onset of heart failure. We compared the correlation of arterial stiffness as assessed by CAVI to LV function in 44 hypertensive patients with preserved EF (EF: 71 ± 7%) and 31 patients with reduced EF (48 ± 8%). All of patients with reduced EF had history of both hypertension and myocardial infarction. Using Doppler echocardiography, LV diastolic and systolic function was evaluated by measuring peak early diastolic mitral annular velocity (e') and global LV peak systolic longitudinal strain (GPSLS), respectively. In patients with preserved EF, CAVI was correlated with e' (r = −0.313, p = 0.038), but not with GPSLS (r = 0.207). By contrast, CAVI was correlated with GPSLS (r = 0.604, p < 0.001) as well as e' (r = −0.393, p = 0.029) in patients with reduced EF. Thus, patients with reduced EF showed a closer correlation of arterial stiffness to LV function compared with patients with preserved EF. Therefore, hypertensive patients with reduced EF require a stricter regimen for treating arterial stiffness than their counterparts with preserved EF.