Moisture significantly affects the mechanical behavior of gas shale and further determines the hydraulic fracturing performance, as it is more attractive. Nevertheless, batch experiments have usually involved variable methodologies regarding the preparation of moisture-contained shale specimens in the sequence (and/or frequency) of drying and soaking treatments. Accordingly, this work investigates how the preparation methodology influences the test results of moisture-contained shale samples. This study compares three commonly used shale sample preparation strategies for acquiring different moisture contents, that is, “dry-wet”, “dry-wet-dry”, and “wet-dry-wet” strategies, followed by a Brazilian splitting test for the mechanical parameters. The results show that under the same saturation conditions, the longer the soaking time during sample preparation, the higher the degradation degree of shale tensile strength. Meanwhile, prolonged soaking can lead to a more discrete distribution of strength values, and the failure mode may deviate from the Brazilian splitting theory model. Under the combined influence of moisture content and soaking time, the tensile strength of shale decreases approximately linearly with increasing saturation, while the degradation degree increases nonlinearly with increasing saturation, and the degradation rate changes from slow to fast. According to the observation of the microstructure of hydrated shale, prolonged soaking can lead to an increase in the expansion of clay minerals in shale by hydration, resulting in looser and more fragmented internal structure, and further degradation in shale strength. In order to weaken the interference of hydration when studying the effect of moisture content on the tensile strength of shale, the soaking time should be minimized as much as possible during the preparation process.