To satisfy the preference of each driver, the development of a Lane-Keeping Assistance (LKA) system that can adapt to individual drivers has become a research hotspot in recent years. However, existing studies have mostly relied on the assumption that the LKA characteristic aligned with the driver’s preference is consistent with this driver’s naturalistic driving characteristic. Nevertheless, this assumption may not always hold true, causing limitations to the effectiveness of this method. This paper proposes a novel method for a Driver-Adaptive Lane-Keeping Assistance (DALKA) system based on drivers’ real preferences. First, metrics are extracted from collected naturalistic driving data using action point theory to describe drivers’ naturalistic driving characteristics. Then, the subjective and objective evaluation method is introduced to obtain the real preference of each test driver for the LKA system. Finally, machine learning methods are employed to train a model that relates naturalistic driving characteristics to the drivers’ real preferences, and the model-predicted preferences are integrated into the DALKA system. The developed DALKA system is then subjectively evaluated by the drivers. The results show that our DALKA system, developed using this method, can enhance or maintain the subjective evaluations of the LKA system for most drivers.