Recently, rapid progress has been achieved in the field of nanomaterial preparation and investigation. Many nanomaterials have been employed in optical chemical sensors and biosensors. This review is focused on fiber-optic nanosensors for chemical sensing based on silica and plastic optical fibers. Four types of fiber-optic chemical nanosensors, namely fiber nanotip sensors, fiber nanoarray sensors, fiber-optic surface plasmon resonance sensors, and fiber-optic nanomaterial-based sensors, are discussed in the paper. The preparation, materials, and sensing characteristics of the selected fiber-optic nanosensors are employed to show the performance of such nanosensors for chemical sensing. Examples of fiber-optic nanobiosensors are also included in the paper to document the broad sensing performance of fiber-optic nanosensors. The employment of fiber-nanotips and nanoarrays for surface-enhanced Raman scattering and nanosensors employing both electrical and optical principles and “Lab-on-fiber” sensors are also included in the paper. The paper deals with fiber-optic nanosensors based on quantum dots, nanotubes, nanorods, and nanosheets of graphene materials, MoS2, and MXenes.