Rice is the staple food in Japan and many other Asian countries, but research on rice-based diets and cardiovascular disease is limited. We aimed to evaluate the association between rice consumption as grain dishes and cardiovascular disease mortality in comparison with bread and noodle consumption. The subjects were 13,355 men and 15,724 women aged ≥35 years who enrolled in the Takayama Study. Diet intake was assessed using a validated food-frequency questionnaire. Causes of death were identified from death certificates. Cardiovascular disease was defined according to the International Classification of Diseases and Health Related Problems, 10th Revision (code I00–I99). Hazard ratios in the second, third, and highest quartiles versus the lowest quartile of rice intake for cardiovascular disease mortality were 0.98, 0.80, and 0.78 for men, respectively (trend p = 0.013), but no significant association was observed among women. Rice intake was positively correlated with the intake of soy products and seaweed, and negatively correlated with the intake of meat and eggs. Neither bread nor noodles were associated with cardiovascular disease mortality. In Japan, choosing rice as a grain dish is likely to be accompanied by healthier foods as side dishes, which may have a potential role in the prevention of cardiovascular disease.