The lack of access to safe water is an urgent problem in rural communities. LDH (layered double hydroxide) is a potent material that effectively adsorbs most pathogens through its positive charge, but its powdery nature restricts its use in batch water. To overcome this, we developed LDH-embedded non-woven fabric sheets (LDH-ES) as a practical solution for sterilizing batch water. Zn/Al-LDH and Mg/Al-LDH were synthesized and embedded in fabric. Using Escherichia coli (DH5 α), two variants of 100 mL of DH5 α inoculated test solutions (1200 CFU/mL) were prepared: nutritionally poor (test water A) and moderately nutritious (test water B). Without adding LDH-ES, the viable counts in test water A were almost unchanged until 24 h, whereas in test water B it increased up to 19,000-fold after 24 h. Upon adding 162 cm2 of Zn/Al-LDH-ES (LDH = 0.2 g), both test water reduced the viable count to 0 CFU/mL after 3 h, achieving complete sterilization. In contrast, with Mg/Al-LDH-ES, the viable count after 24 h was 0 CFU/mL for test water A and 530 CFU/mL for test water B. The superior performance of Zn/Al-LDH-ES is ascribed to the additional antimicrobial effect of zinc. LDH-ES, easily retrievable post-sterilization, proves suitable for disinfecting rural household water.