The Gongsanseong Fortress in Gongju, Republic of Korea, is one of the most essential remains for historical research of Baekje Kingdom, and reinforces on the fortress wall has continuously been implemented since the sixth century to present. Through visual inspections of the fortress ramparts, sections in which structural deformations have occurred, and then they were classified by morphological characteristics based on lithofacies that compose the ramparts, shape of each rock, and construction method. Also, automatic sensors that can measure behavior changes of the ramparts, and the surrounding environment were installed to monitor microscale movements of the ramparts and changes in the surrounding microclimate. As a result, damages were shown intensively on the ramparts that retain specific morphological characteristics, and it has been discovered that, even for the ramparts located in an identical environment, morphological characteristics affect damages and structural deformations of the ramparts because of behavior changes for minutes. Such changes in behavior can be classified based on reversibility and predictability, and different management schemes must be applied based on behavior change patterns. If we continuously operate and develop this monitoring system, it is expected to be meaningfully utilized in efficient maintenance of the cultural heritage of the ramparts.