The paper reports for the first time an innovative polyaniline (PANI)/platinum (Pt)-coated fiber optic-surface plasmon resonance (FO-SPR) sensor used for highly-sensitive 4-nitrophenol (4-NP) pollutant detection. The Pt thin film was coated over an unclad core of an optical fiber (FO) using a DC magnetron sputtering technique, while the 4-NP responsive PANI layer was synthetized using a cost-effective electroless polymerization method. The presence of the electrolessly-grown PANI on the Pt-coated FO was observed by field-emission scanning electron microscopy and subsequently evidenced by energy dispersive X-ray analysis. These FO-SPR sensors with a demonstrated bulk sensitivity of 1515 nm/RIU were then employed for 4-NP sensing, exhibiting an excellent limit-of-detection (LOD) in the low picomolar range (0.34 pM). The proposed sensor’s configuration has many other advantages, such as low-cost production, small size, immunity to electromagnetic interferences, remote sensing capability, and moreover, can be operated as a “stand-alone device”, making it thus well-suited for applications such as “on-site” screening of extremely low-level trace pollutants.