Electrorheological (ER) fluid, which can be transformed rapidly from a fluid-like state to a solid-like state under an external electric field, is considered to be one of the most important smart fluids. However, conventional ER fluids based on microparticles are subjected to challenges in practical applications due to the lack of versatile performances. Recent researches of using nanoparticles as the dispersal phase have led to new interest in the development of non-conventional ER fluids with improved performances. In this review, we especially focus on the recent researches on electrorheology of various nanofiber-based suspensions, including inorganic, organic, and inorganic/organic composite nanofibers. Our goal is to highlight the advantages of using anisotropic nanostructured materials as dispersal phases to improve ER performances.