Nanocellulose is a renewable material that combines a high surface area with high strength, chemical inertness, and versatile surface chemistry. In this review, we will briefly describe how nanocellulose is produced, and present—in particular, how nanocellulose and its surface modified versions affects the adsorption behavior of important water pollutants, e.g., heavy metal species, dyes, microbes, and organic molecules. The processing of nanocellulose-based membranes and filters for water purification will be described in detail, and the uptake capacity, selectivity, and removal efficiency will also be discussed. The processing and performance of nanocellulose-based membranes, which combine a high removal efficiency with anti-fouling properties, will be highlighted.