In addition to their lower cost and more environmentally friendly nature, cellulose nanofibers isolated from unbleached pulps offer different surface properties and functionality than those isolated from bleached pulps. At the same time, nanofibers isolated from unbleached pulps keep interesting properties such as hydrophilicity and mechanical strength, close to those isolated from bleached pulps. In the current work, rice straw nanofibers (RSNF) isolated from unbleached neutral sulfite pulp (lignin content 14%) were used with polysulfone (PSF) polymer to make membrane via phase inversion. The effect of RSNF on microstructure, porosity, hydrophilicity, mechanical properties, water flux, and fouling of PSF membranes was studied. In addition, the prepared membranes were tested to remove lime nanoparticles, an example of medium-size nanoparticles. The results showed that using RSNF at loadings from 0.5 to 2 wt.% can significantly increase hydrophilicity, porosity, water flux, and antifouling properties of PSF. RSNF also brought about an increase in rejection of lime nanoparticles (up to 98% rejection) from their aqueous suspension, and at the same time, with increasing flux across the membranes. Tensile strength of the membranes improved by ~29% with addition of RSNF and the maximum improvement was obtained on using 0.5% of RSNF, while Young’s modulus improved by ~40% at the same RSNF loading. As compared to previous published results on using cellulose nanofibers isolated from bleached pulps, the obtained results in the current work showed potential application of nanofibers isolated from unbleached pulps for improving important properties of PSF membranes, such as hydrophilicity, water flux, rejection, and antifouling properties.