The collective “single‐file” motion of water molecules through natural and artificial nanoconduits inspires the development of high‐performance membranes for water separation. However, a material that contains a large number of pores combining rapid water flow with superior ion rejection is still highly desirable. Here, a 1.2 nm thick carbon nanomembrane (CNM) made from cross‐linking of terphenylthiol (TPT) self‐assembled monolayers is reported to possess these properties. Utilizing their extremely high pore density of 1 sub‐nm channel nm−2, TPT CNMs let water molecules rapidly pass, while the translocation of ions, including protons, is efficiently hindered. Their membrane resistance reaches ≈104 Ω cm2 in 1 m Cl− solutions, comparable to lipid bilayers of a cell membrane. Consequently, a single CNM channel yields an ≈108 higher resistance than pores in lipid membrane channels and carbon nanotubes. The ultrahigh ionic exclusion by CNMs is likely dominated by a steric hindrance mechanism, coupled with electrostatic repulsion and entrance effects. The operation of TPT CNM membrane composites in forward osmosis is also demonstrated. These observations highlight the potential of utilizing CNMs for water purification and opens up a simple avenue to creating 2D membranes through molecular self‐assembly for highly selective and fast separations.