The purpose of this study was to identify gender differences in risk factors of fall accidents among older people, and whether these factors differ between single and recurrent fallers. A total of 4,426 individuals aged ≥65 years from two large-scale health surveys provided data. Logistic regression analyses were used to identify risk factors and to determine the risk model for falling and recurrent falling in men and women separately. Three major risk factors for falling regardless of gender or fall history are fear of falling, limitations in activities of daily living (ADL), and age ≥75 years. Fear of falling remains one of the common modifiable risk factors. Among those without a fall history, the use of sedatives or tranquilizers increases the risk of falling. Regarding gender differences, ADL limitations and fear of falling appear to be stronger fall risk factors for men than for women. Among women, alcohol use and educational level are significant risk factors for falling, while loneliness is associated with recurrent falling. Men with fear of falling or ADL limitations are at higher risk to have a recurrent fall accident than women with these conditions. Having a visual impairment or living with someone is associated with recurrent falling among men. Our findings emphasize the importance of multifactorial fall interventions, taking into account a variety of subgroup characteristics such as gender and fall history.