This paper aims to improve the treatment effect of the multi-soil-layering system (MSL) on rural domestic wastewater. For this, sludge-based biochar materials were selected in the experiments to study its impacts on the treatment of rural domestic wastewater using the MSL. The comparative experiments were conducted for the three MSL systems filled with different materials: the sludge-based biochar (a), wood chips (b), and charcoal (c). The results showed that when the sludge-based biochar material was used as a filler, the removal effect of COD, NH4+-N, TN, TP is better than that of wood chips and charcoal, and the removal rates were 80%, 90%, 65% and 92%, respectively, meeting the Grade A standard specified in the Hebei Province Rural Domestic wastewater Discharge Standard (DB13/2171-2015); hydraulic loading rates (HLRs) have a great impact on the removal of pollutants, and the pollutant indicators in the system (a)re affected by the HLRs in different degrees, i.e., NH4+-N>TP>COD>TN from high to low; considering the treatment efficiency and pollutant removal effect, the HLRs should be selected between 800L/(m2·d) and 1200L/(m2·d). It’s concluded finally that the sludge-based biochar material can strengthen the removal effect of the MSL system. This study is of theoretical value for the further research on MSL system and resource utilization of the sludge.