Proteins are one of the main constituents of living cells. Studying the quantities of proteins under physiological and pathological conditions can give valuable insights into health status, since proteins are the functional molecules of life. To be able to detect and quantify low-abundance proteins in biofluids for applications such as early disease diagnostics, sensitive analytical techniques are desired. An example of this application is using proteins as biomarkers for detecting cancer or neurological diseases, which can provide early, lifesaving diagnoses. However, conventional methods for protein detection such as ELISA, mass spectrometry, and western blotting cannot offer enough sensitivity for certain applications. Recent advances in optical-based micro- and nano-biosensors have demonstrated promising results to detect proteins at low quantities down to the single-molecule level, shining lights on their capacities for ultrasensitive disease diagnosis and rare protein detection. However, to date, there is a lack of review articles synthesizing and comparing various optical micro- and nano-sensing methods of enhancing the limits of detections of the antibody-based protein assays. The purpose of this article is to critically review different strategies of improving assay sensitivity using miniaturized biosensors, such as assay miniaturization, improving antibody binding capacity, sample purification, and signal amplification. The pros and cons of different methods are compared, and the future perspectives of this research field are discussed.