The Lower Cretaceous Shahezi shales are the targets for lacustrine shale gas exploration in Changling Fault Depression (CFD), Southern Songliao Basin. In this study, the Shahezi shales were investigated to further understand the impacts of rock compositions, including organic matters and minerals on pore structure and fractal characteristics. An integrated experiment procedure, including total organic carbon (TOC) content, X-ray diffraction (XRD), field emission-scanning electron microscope (FE-SEM), low pressure nitrogen physisorption (LPNP), and mercury intrusion capillary pressure (MICP), was conducted. Seven lithofacies can be identified according to on a mineralogy-based classification scheme for shales. Inorganic mineral hosted pores are the most abundant pore type, while relatively few organic matter (OM) pores are observed in FE-SEM images of the Shahezi shales. Multimodal pore size distribution characteristics were shown in pore width ranges of 0.5–0.9 nm, 3–6 nm, and 10–40 nm. The primary controlling factors for pore structure in Shahezi shales are clay minerals rather than OM. Organic-medium mixed shale (OMMS) has the highest total pore volumes (0.0353 mL/g), followed by organic-rich mixed shale (ORMS) (0.02369 mL/g), while the organic-poor shale (OPS) has the lowest pore volumes of 0.0122 mL/g. Fractal dimensions D1 and D2 (at relative pressures of 0–0.5 and 0.5–1 of LPNP isotherms) were obtained using the Frenkel–Halsey–Hill (FHH) method, with D1 ranging from 2.0336 to 2.5957, and D2 between 2.5779 and 2.8821. Fractal dimensions are associated with specific lithofacies, because each lithofacies has a distinctive composition. Organic-medium argillaceous shale (OMAS), rich in clay, have comparatively high fractal dimension D1. In addition, organic-medium argillaceous shale (ORAS), rich in TOC, have comparatively high fractal dimension D2. OPS shale contains more siliceous and less TOC, with the lowest D1 and D2. Factor analysis indicates that clay contents is the most significant factor controlling the fractal dimensions of the lacustrine Shahezi shale.