While the macroscopic mechanical properties of earthen-site soils have undergone extensive experimental and modeling studies, few research efforts focus on the relationship between the overall mechanical behavior and micro-pore structure. We developed a microstructure-based finite element model to investigate the influence of micro-pore structure on the macroscopic mechanical behavior of earthen-site soils. Scanning electron microscopy images of the untreated and consolidated soils were processed to compare the changes in equivalent diameter, sphericity, and porosity of the soils after consolidation. According to the pore parameter range of the untreated and consolidated soils, the effects of micro-pores on the soil behavior are specifically conducted under both static and dynamic loads. The relationships between pore characteristics and stiffness, strength, and ultrasonic wave velocity are established.