Colorimetric analysis has become of great importance in recent years to improve the operationalization of plasmonic-based biosensors. The unique properties of nanomaterials have enabled the development of a variety of plasmonics applications on the basis of the colorimetric sensing provided by metal nanoparticles. In particular, the extinction of localized surface plasmon resonance (LSPR) in the visible range has permitted the exploitation of LSPR colorimetric-based biosensors as powerful tools for clinical diagnostics and drug monitoring. This review summarizes recent progress in the biochemical monitoring of clinical biomarkers by ultrasensitive plasmonic colorimetric strategies according to the distance- or the morphology/size-dependent sensing modes. The potential of colorimetric nanosensors as point of care devices from the perspective of naked-eye detection is comprehensively discussed for a broad range of analytes including pharmaceuticals, proteins, carbohydrates, nucleic acids, bacteria, and viruses such as Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2). The practical suitability of plasmonic-based colorimetric assays for the rapid visual readout in biological samples, considering current challenges and future perspectives, is also reviewed.